Operating system, information processing device, control system, and infrared output device

ABSTRACT

An operating system that can control any apparatus is provided. The operating system includes an input receiving device, a first information processing device, a second information processing device, and an infrared output device. The operating system operates a first-type apparatus operable by communication of an infrared pattern and a second-type apparatus operable via a network. The first information processing device is connected to the input receiving device and configured to analyze operation information corresponding to an input operation. The second information processing device is configured to control the second-type apparatus (controlled apparatus (B)) via the network based on a control instruction. The infrared output device is configured to output an infrared pattern corresponding to a control instruction to the first-type apparatus (controlled apparatus (A)).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional application of U.S. patent applicationSer. No. 16/618,821, filed on Dec. 3, 2019, which is a U.S. Nationalstage application of International Application PCT/JP2018/026410, havingan international filing date of Jul. 12, 2018, which claims priorityunder 35 U.S.C. § 119(a) to Japanese Patent Application Nos.2017-138610, 2017-138614, 2017-138615 and 2017-138620, all filed inJapan on Jul. 14, 2017, the entire contents of which are herebyincorporated herein by reference.

BACKGROUND FIELD Field of the Invention

The present invention relates to an operating system, an informationprocessing device, a control system, and an infrared output device.

Background Information

Hitherto, development of an operating device that centralizes theoperations of a plurality of apparatuses has been considered (see, forexample, Japanese Registered Utility Model No. 3130081).

In addition, for example, Japanese Laid-open Patent Publication No.H6-113365 describes a single infrared remote controller with which aplurality of apparatuses is operable.

SUMMARY

In recent years, operation input methods and apparatus managementmethods have been increasing in variety. For this reason, operations forindividual apparatuses that users have can be complicated. With theincrease in variety, there are increasing needs for control systems thatcan normally control apparatuses.

When an apparatus is operated with an infrared remote controller, astate where a behavior differs from the operation made with the infraredremote controller (here, such a state is referred to as operation failedstate) can not be recognized, and the apparatus can be left in a statenot desired by a user.

In such a situation, there are at least following tasks.

The first task is to provide an operating system and informationprocessing device that can control any apparatus.

The second task is to provide a control system and infrared outputdevice that can easily control any apparatus.

The third task is to provide a highly reliable control system.

The fourth task is to provide an operating system with which the statewhere a behavior of an intended apparatus operable with an infraredsignal is inconsistent with an operation for the intended apparatus isless likely to be caused.

First Invention

A first invention for solving the first task is as follows.

An operating system according to a first aspect of the first inventionincludes an input receiving device, a first information processingdevice, a control instruction determination unit, a second informationprocessing device, and an infrared output device. The operating systemoperates a first-type apparatus at least operable by communication of aninfrared pattern and a second-type apparatus at least operable via anetwork. The input receiving device receives an input operation. Thefirst information processing device is connected to the input receivingdevice, and includes an operation information analyzing unit thatanalyzes operation information corresponding to the input operation. Thecontrol instruction determination unit determines whether a resultanalyzed by the operation information analyzing unit includes a controlinstruction to the first-type apparatus or a control instruction to thesecond-type apparatus. The second information processing device isconnected to the first information processing device and, when thecontrol instruction determination unit determines that the controlinstruction to the second-type apparatus is included, controls thesecond-type apparatus via the network based on the control instruction.The infrared output device is connected to the first informationprocessing device and/or the second information processing device and,when the control instruction determination unit determines that thecontrol instruction to the first-type apparatus is included, outputs theinfrared pattern corresponding to the control instruction to thefirst-type apparatus. The first information processing device or thesecond information processing device includes the control instructiondetermination unit.

With the operating system according to the first aspect of the firstinvention, when it is determined that the operation information includesthe control instruction to the first-type apparatus as a result ofanalysis of the operation information, the first-type apparatus iscontrolled by transmitting the infrared pattern to the first-typeapparatus. On the other hand, with the operating system, when it isdetermined that the operation information includes the controlinstruction to the second-type apparatus as a result of analysis of theoperation information, the second-type apparatus is controlled via thenetwork. Therefore, the apparatus not operable via the network (thefirst-type apparatus) is operated by the infrared output device, and theapparatus operable via the network (the second-type apparatus) isoperated by the second information processing device, so any apparatuscan be controlled.

An operating system according to a second aspect of the first inventionis the operating system according to the first aspect of the firstinvention, wherein the operating system includes an operating devicethat accommodates the input receiving device and the infrared outputdevice in one and the same casing. Since the input receiving device andthe infrared output device are accommodated in the same casing as theoperating device, any apparatus around the operating device can becontrolled regardless of whether the apparatus is an apparatus operablevia the network (second-type apparatus) or not.

An operating system according to a third aspect of the first inventionis the operating system according to the first aspect or second aspectof the first invention, wherein the input receiving device determineswhether the second-type apparatus has been controlled by the secondinformation processing device and transmits a determined result to thefirst information processing device.

With the operating system according to the third aspect of the firstinvention, the input receiving device (the operating device) determineswhether the second-type apparatus has been controlled by the secondinformation processing device and transmits the determined result to thefirst information processing device. Therefore, for example, even whenan administrator of the first information processing device is differentfrom an administrator of the second information processing device, theadministrator of the first information processing device is able tojudge whether the second-type apparatus has been controlled by thesecond information processing device. Thus, the operating system can beappropriately managed.

An operating system according to a fourth aspect of the first inventionis the operating system of any one of the first to third aspects of thefirst invention, wherein the input receiving device determines whetherthe first-type apparatus has been controlled by transmission of theinfrared pattern and transmits a determined result to the firstinformation processing device and/or the second information processingdevice.

With the operating system according to the fourth aspect of the firstinvention, the input receiving device (the operating device) determineswhether the first-type apparatus has been controlled by transmission ofthe infrared pattern and transmits the determined result to the firstinformation processing device and/or the second information processingdevice. Therefore, the administrator of the first information processingdevice and/or the administrator of the second information processingdevice is able to judge whether the first-type apparatus has beencontrolled. For example, when the administrator of the first informationprocessing device and/or the administrator of the second informationprocessing device has received the determined result that the first-typeapparatus has not been controlled, a transmission instruction fortransmit of the infrared pattern can be provided to the infrared outputdevice again. Thus, the reliability of the operating system is improved.

An operating system according to a fifth aspect of the first inventionis the operating systems according to the first to fourth aspects of thefirst invention, wherein the second information processing device, whenthe result determined by the control instruction determination unitincludes the control instruction to the first-type apparatus, transmits,to the infrared output device, an output instruction to output theinfrared pattern corresponding to the control instruction.

With the operating system according to the fifth aspect of the firstinvention, the second information processing device transmits the outputinstruction to the infrared output device. Therefore, in the secondinformation processing device, it can be judged whether the first-typeapparatus has been controlled. As a result, the reliability of theoperating system is improved.

An operating system according to a sixth aspect of the first inventionis the operating systems according to the first to fifth aspects of thefirst invention, wherein the second information processing device or theinfrared output device further includes an infrared pattern generatingunit to generate the infrared pattern corresponding to a control contentover the first-type apparatus.

The operating system according to the sixth aspect of the firstinvention includes the infrared pattern generating unit to generate theinfrared pattern corresponding to the control content over thefirst-type apparatus. Therefore, a desired first-type apparatus can becontrolled. As a result, extensibility to the first-type apparatus isimproved.

An operating system according to a seventh aspect of the first inventionis the operating systems according to the first to sixth aspects of thefirst invention, wherein the first-type apparatus includes multiplemodels, and the infrared pattern corresponding to the controlinstruction varies among the models. With this configuration,multiple-model first-type apparatuses can be controlled by usinginfrared patterns (exclusive commands) that vary among the models.

An operating system according to an eighth aspect of the first inventionis the operating systems according to the first to seventh aspects ofthe first invention, wherein the second-type apparatus includes theinput receiving device and/or the infrared output device.

With the operating system according to the eighth aspect of the firstinvention, the operating device is accommodated in the second-typeapparatus. Therefore, a system configuration is simplified.

An operating system according to a ninth aspect of the first inventionis the operating systems according to the first to eighth aspects of thefirst invention, wherein the input operation is voice input throughvoice.

With the operating system according to the ninth aspect of the firstinvention, the first-type apparatus and the second-type apparatus can becontrolled by voice input.

An operating system according to a tenth aspect of the first inventionis the operating systems according to the first to ninth aspects of thefirst invention, wherein the input receiving device includes a specificoperation information identifying unit, a specific operation storageunit, and a specific operation execution unit. The specific operationinformation identifying unit identifies specific operation informationto the second-type apparatus in the operation information correspondingto the input operation. The specific operation storage unit stores thespecific operation information in association with a specific operation.When the specific operation information has been identified by thespecific operation information identifying unit, the specific operationexecution unit executes the specific operation to the second-typeapparatus.

With the operating system according to the tenth aspect of the firstinvention, the input receiving device executes the specific operation tothe second-type apparatus when the specific operation information to thesecond-type apparatus has been identified. Therefore, the second-typeapparatus can be controlled without access to the first informationprocessing device or the second information processing device on thenetwork.

An operating system according to an eleventh aspect of the firstinvention is the operating systems according to the first to tenthaspects of the first invention, wherein the second informationprocessing device further includes an environmental informationacquiring unit. The environmental information acquiring unit isconfigured to acquire environmental information at predetermined timingfrom an environmental information detecting apparatus that detects theenvironmental information that indicates a status of a surroundingenvironment. When the result determined by the control instructiondetermination unit includes the control instruction to the first-typeapparatus, the second information processing device transmits, to theinfrared output device, an output instruction to output the infraredpattern based on the control instruction and the environmentalinformation to the first-type apparatus. When it is determined that thedetermined result includes the control instruction to the second-typeapparatus, the second information processing device controls thesecond-type apparatus via the network based on the control instructionand the environmental information.

With the operating system according to the eleventh aspect of the firstinvention, when the determined result includes the control instructionto the first-type apparatus, the second information processing devicetransmits, to the infrared output device, the output instruction tooutput the infrared pattern based on the control instruction and theenvironmental information. Therefore, the apparatus can be appropriatelycontrolled according to the environment of the user. When it isdetermined that the determined result includes the control instructionto the second-type apparatus, the second-type apparatus is controlledvia the network based on the control instruction and the environmentalinformation. Therefore, the apparatus can be appropriately controlledaccording to the environment of the user.

An operating system according to a twelfth aspect of the first inventionis the operating systems according to the first to eleventh aspects ofthe first invention, wherein the second information processing devicefurther includes an environmental information acquiring unit, anassociated apparatus storage unit, an associated apparatus extractingunit, and an associated apparatus control unit. The environmentalinformation acquiring unit acquires environmental information atpredetermined timing from an environmental information detectingapparatus that detects the environmental information that indicates astatus of a surrounding environment. The associated apparatus storageunit stores, in association with any one of the first-type apparatus andthe second-type apparatus and the environmental information, any one orany combination of another first-type apparatus or another second-typeapparatus as an associated apparatus(es). When the control instructiondetermination unit determines that the control instruction to thefirst-type apparatus or the control instruction to the second-typeapparatus is included, the associated apparatus extracting unit extractsthe associated apparatus(es) from the associated apparatus storage unit.The associated apparatus control unit, when another first-type apparatusis extracted by the associated apparatus extracting unit as theassociated apparatus, transmits, to the infrared output device, theoutput instruction of the infrared pattern corresponding to a controlcontent over the extracted associated apparatus, and/or, when anothersecond-type apparatus is extracted by the associated apparatusextracting unit as the associated apparatus, controls the extractedassociated apparatus via the network.

With the operating system according to the twelfth aspect of the firstinvention, the second information processing device stores anotherapparatus in association with the first-type apparatus, the second-typeapparatus, and the environmental information as the associatedapparatus(es), and controls not only the first apparatus or the secondapparatus but also the associated apparatus(es) according to theenvironment of the user. Therefore, user's comfort is improved.

The term “another apparatus” in the present invention means an apparatusdifferent from the apparatus that is the control object.

An operating system according to a thirteenth aspect of the firstinvention is the operating systems according to the first to twelfthaspects of the first invention, wherein the second informationprocessing device further includes a specific situation detecting unit,a specific situation storage unit, and a specific situation controlunit. The specific situation detecting unit detects a specificsituation. The specific situation storage unit stores the specificsituation in association with a predetermined first-type apparatus and acontrol content over the first-type apparatus. The specific situationstorage unit also stores the specific situation in association with apredetermined second-type apparatus and a control content over thesecond-type apparatus. When a specific situation has been detected, thespecific situation control unit transmits, to the infrared outputdevice, an output instruction to output the infrared patterncorresponding to the control content associated with the specificsituation regardless of the operation information. Further, the specificsituation control unit controls the second-type apparatus with thecontrol content associated with the specific situation.

With the operating system according to the thirteenth aspect of thefirst invention, when the specific situation has been detected, thecontrol content over the first-type apparatus, associated with thespecific situation, is transmitted to the operating device. Thisconfiguration allows the user to recognize the specific situation. Inaddition, when the specific situation has been detected, the second-typeapparatus is controlled with the control content associated with thespecific situation. This configuration allows the user to recognize thespecific situation.

An operating system according to a fourteenth aspect of the firstinvention is the operating systems according to the first to thirteenthaspects of the first invention, wherein the first information processingdevice is communicable with a third information processing device thatis able to operate, via the network, a third-type apparatus differentfrom the second-type apparatus.

Further, the control instruction determination unit further determineswhether the result analyzed by the operation information analyzing unitincludes a control instruction to a control instruction to thethird-type apparatus. When the control instruction determination unitdetermines that the control instruction to the third-type apparatus isincluded, the first information processing device transmits an operationcommand corresponding to the control instruction to the thirdinformation processing device.

With the operating system according to the fourteenth aspect of thefirst invention, when it is determined that the operation informationincludes the control instruction to the first-type apparatus as a resultof the analysis of the operation information, the first-type apparatusis controlled by transmission of the infrared pattern to the first-typeapparatus. With the operating system, when it is determined that theoperation information includes the control instruction to thesecond-type apparatus as a result of the analysis of the operationinformation, the second-type apparatus is controlled via the network.With the operating system, when it is determined that the operationinformation includes the control instruction to the third-type apparatusas a result of the analysis of the operation information, the operationcommand to the third-type apparatus is transmitted via the network tothe third information processing device that is able to operate thethird-type apparatus.

Therefore, the operating system that is able to not only operate thefirst-type apparatus and the second-type apparatus but also transmit anoperation command to the third-type apparatus not operable by the secondinformation processing device can be provided. As a result, an operatingsystem with further high extensibility can be provided.

An operating system according to a fifteenth aspect of the presentinvention is the operating system according to the fourteenth aspect,wherein the second information processing device and the second-typeapparatus are connected via a first communication adaptor thatcommunicates by using a first communication protocol. The thirdinformation processing device and the third-type apparatus are connectedvia a second communication adaptor that communicates by using a secondcommunication protocol different from the first communication protocol.

With the operating system according to the fifteenth aspect of the firstinvention, the operating system that is also able to transmit anoperation command to the third-type apparatus that communicates by usinga communication protocol different from that of the second-typeapparatus can be provided.

An operating system according to a sixteenth aspect of the firstinvention is operating system according to the fourteenth or fifteenthaspect of the first invention, wherein the input receiving devicedetermines whether the third-type apparatus has been controlled by thethird information processing device and transmit a determined result tothe first information processing device and/or the second informationprocessing device.

With the operating system according to the sixteenth aspect of the firstinvention, the input receiving device (operating device) determineswhether the third-type apparatus has been controlled and transmits adetermined result to the first information processing device and/or thesecond information processing device. Therefore, for example, even whenan administrator of the first information processing device and/or anadministrator of the second information processing device is differentfrom an administrator of the third information processing device, theadministrator of the first information processing device and/or theadministrator of the second information processing device is able tojudge whether the third-type apparatus has been controlled by the thirdinformation processing device. Thus, the operating system can be furtherappropriately managed.

An operating system according to a seventeenth aspect of the firstinvention is the operating systems according to the fourteenth tosixteenth aspects of the first invention, wherein the second informationprocessing device further includes an environmental informationacquiring unit, an associated apparatus storage unit, an associatedapparatus extracting unit, and an associated apparatus control unit. Theenvironmental information acquiring unit acquires environmentalinformation at predetermined timing from an environmental informationdetecting apparatus configured to detect the environmental informationthat indicates a status of a surrounding environment. The associatedapparatus storage unit stores, in association with any one of thefirst-type apparatus, the second-type apparatus, and the third-typeapparatus and the environmental information, any one or any combinationof another first-type apparatus, another second-type apparatus, oranother third-type apparatus as an associated apparatus(es). When thecontrol instruction determination unit determines that the controlinstruction to any one of the first-type apparatus, the second-typeapparatus, and the third-type apparatus is included, the associatedapparatus extracting unit extracts the associated apparatus(es) from theassociated apparatus storage unit. When another first-type apparatus isextracted by the associated apparatus extracting unit as the associatedapparatus, the associated apparatus control unit transmits, to theinfrared output device, an output instruction to output the infraredpattern corresponding to a control content over the extracted associatedapparatus. Further, when another second-type apparatus is extracted bythe associated apparatus extracting unit as the associated apparatus,the associated apparatus control unit controls the extracted associatedapparatus via the network. Further, when another third-type apparatus isextracted by the associated apparatus extracting unit as the associatedapparatus, the associated apparatus control unit ransmits an operationcommand corresponding to the control instruction to the associatedapparatus to the third information processing device.

With the operating system according to the seventeenth aspect of thefirst invention, when the third-type apparatus is extracted as theassociated apparatus, the second information processing device transmitsan operation command to the associated apparatus that is the third-typeapparatus via the network based on the control instruction and theenvironmental information. Therefore, the apparatus can be appropriatelycontrolled according to the environment of the user.

A second information processing device according to an eighteenth aspectof the first invention is connected to a first information processingdevice and an infrared output device via a network. The firstinformation processing device includes an operation informationanalyzing unit that analyzes operation information corresponding to aninput operation, and a control instruction determination unit thatdetermines whether a result analyzed by the operation informationanalyzing unit includes a control instruction to a first-type apparatusat least operable by communication of an infrared pattern or a controlinstruction to a second-type apparatus at least operable via thenetwork. When the control instruction determination unit determines thatthe control instruction to the first-type apparatus is included, theinfrared output device outputs the infrared pattern corresponding to thecontrol instruction to the first-type apparatus. When the controlinstruction determination unit determines that the control instructionto the second-type apparatus is included, the second informationprocessing device controls the second-type apparatus via the networkbased on the control instruction.

The second information processing device according to the eighteenthaspect of the first invention is connected to the first informationprocessing device and the infrared output device and, when it isdetermined that the operation information includes the controlinstruction to the second-type apparatus as a result of analysis of theoperation information, controls the second-type apparatus via thenetwork. Therefore, the apparatus not operable via the network isoperated by the infrared output device, and the apparatus operable viathe network is operated by the second information processing device.Thus, an operating system that can control any apparatus can beconstructed.

A second information processing device according to a nineteenth aspectof the first invention is the second information processing deviceaccording to the eighteenth aspect of the first invention, receives aresult determined by the control instruction determination unit from thefirst information processing device and, when the determined resultincludes the control instruction to the first-type apparatus, transmits,to the infrared output device, an output instruction to output theinfrared pattern corresponding to the control instruction. With such aconfiguration, the second information processing device transmits anoutput instruction to the infrared output device. Therefore, in thesecond information processing device, it can be judged whether thefirst-type apparatus has been controlled.

A second information processing device according to a twentieth aspectof the first invention is the second information processing deviceaccording to the eighteenth or nineteenth aspect of the first invention,and further includes an infrared pattern generating unit configured togenerate the infrared pattern corresponding to a control content overthe first-type apparatus.

With the second information processing device according to the twentiethaspect of the first invention, the second information processing deviceincludes the infrared pattern generating unit that generates theinfrared pattern corresponding to the control content over thefirst-type apparatus. Therefore, the second information processingdevice is able to control the first-type apparatus by transmission ofthe infrared pattern corresponding to the control content to thefirst-type apparatus.

A second information processing device according to a twenty-firstaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twentieth aspects ofthe first invention, wherein the first-type apparatus includes multiplemodels, and the infrared pattern corresponding to the controlinstruction varies among the models. With this configuration,multiple-model first-type apparatuses can be controlled by usinginfrared patterns (exclusive commands) that vary among the models.

A second information processing device according to a twenty-secondaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twenty-first aspects ofthe first invention, wherein the input operation is voice input throughvoice.

With the second information processing device according to thetwenty-second aspect of the first invention, the first-type apparatusand the second-type apparatus can be controlled by voice input.

A second information processing device according to a twenty-thirdaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twenty-second aspectsof the first invention, and further includes an environmentalinformation acquiring unit that acquires environmental information atpredetermined timing from an environmental information detectingapparatus to detect the environmental information that indicates astatus of a surrounding environment. The second information processingdevice receives a result determined by the control instructiondetermination unit from the first information processing device and,when the determined result includes the control instruction to thefirst-type apparatus, transmits, to the infrared output device, theoutput instruction to output an infrared pattern based on the controlinstruction and the environmental information. When it is determinedthat the determined result includes the control instruction to thesecond-type apparatus, the second information processing device controlsthe second-type apparatus based on the control instruction and theenvironmental information via the network.

With the second information processing device according to thetwenty-third aspect of the first invention, the second informationprocessing device receives the determined result from the firstinformation processing device and, when the determined result includesthe control instruction to the first-type apparatus, transmits, to theinfrared output device, an output instruction to output the infraredpattern to the first-type apparatus based on the control instruction andthe environmental information. Therefore, the apparatus can beappropriately controlled according to the environment of the user.Further, when it is determined that the determined result includes thecontrol instruction to the second-type apparatus, the second-typeapparatus is controlled based on the control instruction and theenvironmental information via the network. Therefore, the apparatus canbe appropriately controlled according to the environment of the user.

A second information processing device according to a twenty-fourthaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twenty-third aspects ofthe first invention, includes an environmental information acquiringunit, an associated apparatus storage unit, an associated apparatusextracting unit, and an associated apparatus control unit. Theenvironmental information acquiring unit acquires environmentalinformation at predetermined timing from an environmental informationdetecting apparatus that detects the environmental information thatindicates a status of a surrounding environment. The associatedapparatus storage unit stores, in association with any one of thefirst-type apparatus and the second-type apparatus and the environmentalinformation, any one or any combination of another first-type apparatusor another second-type apparatus as an associated apparatus(es). Whenthe control instruction determination unit determines that the controlinstruction to the first-type apparatus or the control instruction tothe second-type apparatus is included, the associated apparatusextracting unit extracts the associated apparatus(es) from theassociated apparatus storage unit. When another first-type apparatus isextracted by the associated apparatus extracting unit as the associatedapparatus, the associated apparatus control unit transmits, to theinfrared output device, an output instruction to output the infraredpattern corresponding to a control content over the extracted associatedapparatus. When another second-type apparatus is extracted by theassociated apparatus extracting unit as the associated apparatus, theassociated apparatus control unit controls the extracted associatedapparatus via the network.

With the second information processing device according to thetwenty-fourth aspect of the first invention, the control device stores apredetermined apparatus and another apparatus in association with theenvironmental information as an associated apparatus, and controls notonly the first apparatus or the second apparatus but also the associatedapparatus according to the environment of the user. Therefore, comfortof the user is improved.

A second information processing device according to a twenty-fifthaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twenty-fourth aspectsof the first invention, includes a specific situation detecting unit, aspecific situation storage unit, and a specific situation control unit.The specific situation detecting unit detects a specific situation. Thespecific situation storage unit stores the specific situation inassociation with a predetermined first-type apparatus and the controlcontent over the first-type apparatus. Further, the specific situationstorage unit stores the specific situation in association with apredetermined second-type apparatus and a control content over thesecond-type apparatus. When the specific situation has been detected,the specific situation control unit transmits, to the infrared outputdevice, an output instruction to output the infrared patterncorresponding to the control content associated with the specificsituation regardless of the operation information. Also, the specificsituation control unit controls the second-type apparatus with thecontrol content associated with the specific situation.

With the second information processing device according to thetwenty-fifth aspect of the first invention, when the specific situationhas been detected, the control content over the first-type apparatus,associated with the specific situation, is transmitted to the operatingdevice. This configuration allows the user to recognize the specificsituation. In addition, when a specific situation has been detected, thesecond-type apparatus is controlled with the control content associatedwith the specific situation. This configuration allows the user torecognize the specific situation.

A second information processing device according to a twenty-sixthaspect of the first invention is the second information processingdevice according to any one of the eighteenth to twenty-fifth aspects ofthe first invention, and further includes an environmental informationacquiring unit, an associated apparatus storage unit, an associatedapparatus extracting unit, and an associated apparatus control unit.Here, the first information processing device is communicable with athird information processing device that is able to operate a third-typeapparatus different from the second-type apparatus via the network, thecontrol instruction determination unit further determines whether theresult analyzed by the operation information analyzing unit includes acontrol instruction to the third-type apparatus and, when the controlinstruction determination unit determines that the control instructionto the third-type apparatus is included, transmits an operation commandcorresponding to the control instruction to the third informationprocessing device. The environmental information acquiring unit acquiresenvironmental information at predetermined timing from an environmentalinformation detecting apparatus configured to detect the environmentalinformation that indicates a status of a surrounding environment. Theassociated apparatus storage unit stores, in association with any one ofthe first-type apparatus, the second-type apparatus, and the third-typeapparatus and the environmental information, any one or any combinationof another first-type apparatus, another second-type apparatus, oranother third-type apparatus as an associated apparatus(es). When thecontrol instruction determination unit determines that the controlinstruction to any one of the first-type apparatus, the second-typeapparatus, and the third-type apparatus is included, the associatedapparatus extracting unit extracts the associated apparatus(es) from theassociated apparatus storage unit. When another first-type apparatus isextracted by the associated apparatus extracting unit as the associatedapparatus, the associated apparatus control unit transmits, to theinfrared output device, an output instruction to output the infraredpattern corresponding to a control content over the extracted associatedapparatus. When another second-type apparatus is extracted by theassociated apparatus extracting unit as the associated apparatus, theassociated apparatus control unit controls the extracted associatedapparatus via the network. When another third-type apparatus isextracted by the associated apparatus extracting unit as the associatedapparatus, the associated apparatus control unit transmits, to the thirdinformation processing device, an operation command corresponding to thecontrol instruction to the associated apparatus.

With the second information processing device according to thetwenty-sixth aspect of the first invention, when the third-typeapparatus is extracted as the associated apparatus, the secondinformation processing device transmits the operation command to theassociated apparatus that is the third-type apparatus based on thecontrol instruction and the environmental information via the network.Therefore, the apparatus can be appropriately controlled according tothe environment of the user.

A second information processing device according to a twenty-seventhaspect of the first invention is connected to a first informationprocessing device and an infrared output device via a network. The firstinformation processing device includes an operation informationanalyzing unit that analyze operation information corresponding to aninput operation. When a result analyzed by the operation informationanalyzing unit includes a control instruction to a first-type apparatusat least operable by communication of an infrared pattern, the infraredoutput device outputs the infrared pattern corresponding to the controlinstruction to the first-type apparatus. The second informationprocessing device includes a control instruction determination unit anda second control unit. The control instruction determination unitdetermines whether the result analyzed by the operation informationanalyzing unit includes the control instruction to the first-typeapparatus at least operable by communication of the infrared pattern orthe control instruction to a second-type apparatus at least operable viaa network. When the control instruction determination unit determinesthat the control instruction to the second-type apparatus is included,the second control unit controls the second-type apparatus via thenetwork based on the control instruction.

The second information processing device according to the twenty-seventhaspect of the first invention is connected to the first informationprocessing device and the infrared output device, when it is determinedthat the operation information includes the control instruction to thesecond-type apparatus as a result of analysis of the operationinformation, controls the second-type apparatus via the network.Therefore, the apparatus not operable via the network is operated by theinfrared output device, and the apparatus operable via the network isoperated by the second information processing device. Therefore, anoperating system that can control any apparatus can be constructed.

Second Invention

A second invention for solving the second task is as follows.

A control system according to a first aspect of the second inventionincludes an input receiving device and an infrared output device. Theinput receiving device receives a control command to a controlledapparatus controllable by infrared ray through voice input. The infraredoutput device is installed in a fixed apparatus whose position is fixedin a predetermined space. When the input receiving device has receivedthe control command, the infrared output device outputs infrared ray tothe controlled apparatus.

With the control system according to the first aspect of the secondinvention, the control system includes the above-described components.Therefore, the controlled apparatus can be controlled by voice inputthrough infrared ray. Further, since the position of the fixed apparatusis fixed in a predetermined space, the range of infrared ray that isoutput by the infrared output device installed in the fixed apparatuscan be estimated in advance. Therefore, as long as apparatuses presentin the range are controllable by the infrared ray, the infrared outputdevice is able to easily control any controlled apparatus. Further, theinfrared output device is installed in the fixed apparatus, so noinstallation space for the infrared output device is required.

A control system according to a second aspect of the second invention isthe control system according to the first aspect of the secondinvention, wherein the fixed apparatus is fixedly mounted on a ceilingor wall of a room. Alternatively, the control system according to thesecond aspect of the second invention is fixedly embedded in a ceilingor wall of a room.

With the control system according to the second aspect of the secondinvention, the fixed apparatus is fixedly mounted on a ceiling or wallof a room. For example, a luminaire, an air-conditioning device, or thelike, may be used as the fixed apparatus. Alternatively, the fixedapparatus is fixedly embedded in the ceiling or wall of the room. Forexample, a luminaire, an air-conditioning device, a wall-hangingtelevision, or the like, may be used as the fixed apparatus. By usingsuch a fixed apparatus, the probability of avoiding a shield placed in atransmission path of infrared ray in a predetermined space can beincreased. In other words, the probability that infrared ray reaches acontrolled apparatus can be increased. As a result, the reliability ofthe control system is improved. Arrangement of the fixed apparatus isgenerally considered in space design. With the control system accordingto the second aspect, the controlled apparatus can be appropriatelycontrolled in a space designed in consideration of arrangement of thefixed apparatus.

A control system according to a third aspect of the second invention isthe control system according to the first or second aspect of the secondinvention, wherein the fixed apparatus is an air-conditioning device.Generally, the air-conditioning device is installed at a higher position(near the ceiling of the room, or the like). Therefore, with the controlsystem according to the third aspect, a controlled apparatus present ata location lower in position than a location where the air-conditioningdevice is installed can be easily controlled.

A control system according to a fourth aspect of the second invention isthe control system of any one of the first to third aspects of thesecond invention, wherein the infrared output device is mounted on anupper-half region of a body of the fixed apparatus. Therefore, with thecontrol system according to the fourth aspect, infrared ray can beoutput from a higher position. Thus, the probability of avoiding ashield placed in a transmission path of infrared ray in a predeterminedspace can be increased. For example, the infrared output device ismounted at an upper part of a floor-standing air-conditioning device.

A control system according to a fifth aspect of the second invention isthe control system according to any one of the first to fourth aspectsof the second invention, the input receiving device is disposed insidethe fixed apparatus.

With the control system according to the fifth aspect of the secondinvention, the input receiving device is disposed inside the fixedapparatus. Therefore, a system configuration is simplified. In addition,no installation space for the input receiving device is required.

A control system according to a sixth aspect of the second invention isthe control system according to any one of the first to fifth aspects ofthe second invention, wherein an attitude control device to control anattitude of the infrared output device is installed in the infraredoutput device.

With the control system according to the sixth aspect of the secondinvention, the output direction of infrared ray can be changed to adesired direction. Therefore, the probability that infrared ray reachesthe controlled apparatus can be increased. As a result, the reliabilityof the control system is improved.

A control system according to a seventh aspect of the second inventionis the control system according to any one of the first to sixth aspectsof the second invention, and further includes an information processingdevice that is able to communicate with the input receiving device andthe infrared output device via the network. The information processingdevice includes a voice analyzing unit, a control identifying unit, andan output instruction transmission unit. The voice analyzing unitanalyzes voice input. The control identifying unit identifies a controlcontent that indicates a controlled apparatus and a control command tothe controlled apparatus from a result analyzed by the voice analyzingunit. The output instruction transmission unit transmits, to theinfrared output device, an output instruction to output infrared raybased on the control content identified by the control identifying unit.

With the control system according to the seventh aspect of the secondinvention, the information processing device on the network transmits,to the infrared output device, an output instruction to output infraredray based on the analyzed result of analysis of the voice input. Whenthe apparatus is intended to be controlled by the voice input, theamount of information processing can be enormous. In such a case aswell, with the control system according to the seventh aspect, the voiceanalysis is executed with high accuracy by using the informationprocessing device on the network. Therefore, the controlled apparatusand the control command can be minutely identified. As a result, thecontrol system that can easily control any apparatus can be provided.

An infrared output device according to an eighth aspect of the secondinvention is installed in a fixed apparatus whose position is fixed in apredetermined space. When an input receiving device, which receives,through voice input, a control command to a controlled apparatus that iscontrollable by infrared ray, has received the control command, theinfrared output device outputs infrared ray to the controlled apparatus.

With the infrared output device according to the eighth aspect of thesecond invention, the position of the fixed apparatus is fixed.Therefore, the range of infrared output can be estimated in advance. Inaddition, the infrared output device outputs, to a controlled apparatus,infrared ray based on voice input via a voice receiving device.Therefore, as long as apparatuses present in the range are controllableby infrared ray, the infrared output device is able to easily controlany controlled apparatus. In addition, the infrared output device isinstalled in the fixed apparatus. Therefore, no installation space forthe infrared output device is required.

Third Invention

A third invention for solving the third task is as follows.

A control system according to a first aspect of the third inventionincludes an input receiving device, an infrared output device, anenvironmental information detecting device, and an informationprocessing device. The input receiving device receives a control commandto a controlled apparatus controllable by infrared ray. The infraredoutput device is configured to output infrared ray to the controlledapparatus. The environmental information detecting device is configuredto detect environmental information around the controlled apparatus. Theinformation processing device receives a control command from the inputreceiving device and transmits, to the infrared output device, an outputinstruction to output infrared ray based on the control command. Here,the information processing device receives the environmental informationfrom the environmental information detecting device and determines thatthe controlled apparatus has been controlled based on the outputinstruction and the environmental information.

With the control system according to the first aspect of the thirdinvention, the information processing device receives the environmentalinformation from the environmental information detecting device anddetermines whether the controlled apparatus has been controlled based onthe output instruction and the environmental information. Therefore,when the controlled apparatus has not been controlled, a process inwhich the controlled apparatus is controlled can be executed. Forexample, the output instruction is resent or transmission of the outputinstruction is prompted by informing an administrator of the controlledapparatus that the controlled apparatus has not been controlled. As aresult, the control system with high reliability can be provided.

A control system according to a second aspect of the third invention isthe control system according to the first aspect of the third invention,wherein the information processing device, when the informationprocessing device determines that the controlled apparatus has not beencontrolled, retransmits the output instruction to the infrared outputdevice. Thus, the controlled apparatus is reliably controlled, so thecontrol system with high reliability can be provided.

A third aspect of the third invention is the control process accordingto the first or second aspect of the third invention, wherein theinformation processing device, when the information processing devicedetermines that the controlled apparatus has not been controlled,transmits, to the input receiving device, notification that thecontrolled apparatus has not been controlled. Thus, a user of the inputreceiving device is prompted to input the control command again, so thecontrolled apparatus is reliably controlled. As a result, the controlsystem with high reliability can be provided.

A control system according to a fourth aspect of the third invention isthe control to system according to any one of the first to third aspectsof the third invention, wherein an attitude control device to control anattitude of the infrared output device is installed in the infraredoutput device.

With the control system according to the fourth aspect of the thirdinvention, the output direction of infrared ray can be changed to adesired direction. Therefore, the probability that infrared ray reachesa controlled apparatus can be increased. As a result, the reliability ofthe control system is improved.

An information processing device according to a fifth aspect of thethird invention is connected to an input receiving device, an infraredoutput device, and an environmental information detecting device. Theinput receiving device receives a control command to a controlledapparatus controllable by infrared ray. The infrared output deviceoutputs infrared ray to the controlled apparatus. The environmentalinformation detecting device detects environmental information aroundthe controlled apparatus. The information processing device according tothe fifth aspect includes an output instruction transmission unit and acontrol determination unit. The output instruction transmission unitreceives a control command from the input receiving device and transmit,to the infrared output device, an output instruction to output infraredray based on the control command. The control determination unitreceives the environmental information from the environmentalinformation detecting device and determines that the controlledapparatus has been controlled based on the output instruction to outputinfrared ray and the environmental information.

With the information processing device according to the fifth aspect ofthe third invention, the information processing device receives theenvironmental information from the environmental information detectingdevice and determines whether the controlled apparatus has beencontrolled based on the output instruction and the environmentalinformation. Therefore, when the controlled apparatus has not beencontrolled, a process in which the controlled apparatus is controlledcan be executed. For example, an output instruction is resent or anadministrator of a controlled apparatus is prompted to transmit anoutput instruction by informing that the controlled apparatus has notbeen controlled. As a result, the control system with high reliabilitycan be provided.

Fourth Invention

A fourth invention for solving the fourth task is as follows.

An operating system according to a first aspect of the fourth inventionincludes an air conditioner and an infrared output device. The airconditioner includes an indoor unit. The infrared output device isinstalled in the indoor unit or mounted on a wall surface or ceilingsurface near the indoor unit. The infrared output device receives firstinformation on an instruction to an apparatus to be operated andtransmits an infrared signal corresponding to the first information tothe apparatus to be operated. The apparatus to be operated is anapparatus other than the air conditioner and is operable by an infraredsignal. The air conditioner includes an apparatus management deviceconfigured to manage the apparatus to be operated. The apparatusmanagement device includes a command information receiving unit and adetermination unit. The command information receiving unit receivessecond information on a command content. The determination unitdetermines whether there is a deviation between a behavior of theapparatus to be operated and the command content based on the behaviorof the apparatus to be operated and the second information.

Here, the apparatus management device of the air conditioner determineswhether an actual behavior of the apparatus to be operated isinconsistent with the command content to the apparatus to be operated.Therefore, the state where the actual behavior is inconsistent with thecommand content (operation failed state) is hardly left as it is.

The behavior whose inconsistency is determined desirably includes atleast a start or stop of the apparatus to be operated. In other words,the determination unit desirably determine at least whether theapparatus to be operated has started or stopped as operated when theapparatus to be operated is operated to start or stop with the infraredoutput device.

When the air conditioner includes the apparatus management device, thefollowing advantages are obtained.

Houses, offices, and the like, are often air-conditioned by airconditioners. For this reason, when the air conditioner includes theapparatus management device, the apparatus to be operated can be managedwithout additionally providing a device exclusively managing theapparatus. Therefore, equipment cost tends to be reduced.

In addition, when the infrared output device is disposed in the indoorunit of the air conditioner or on a wall surface or ceiling surface nearthe indoor unit, the following advantages are obtained.

Furniture, and the like, is placed in a house, an office, or the like.Furniture, and the like, can be obstacles depending on the installationposition of the infrared output device. As a result, an infrared signalmay not reach an infrared photoreceiving portion of the apparatus to beoperated.

The indoor unit is often provided on a ceiling or near a ceiling fromwhich a space can be looked over from its original functional viewpoint.Moreover, to achieve the purpose of air-conditioning, there is a lowpossibility that furniture, such as a shelf, is disposed near the indoorunit so as to interfere with sending of air. In other words, there is arelatively low possibility that an obstacle that interferes withtransmission of an infrared signal is installed near the indoor unit.

For this reason, with the operating system in which the infrared outputdevice is installed in the indoor unit of the air conditioner or on awall surface or ceiling surface near the indoor unit, the state where anoperation content in a command from the infrared output device isinconsistent with an actual behavior of an apparatus hardly occurs inthe first place.

An operating system according to a second aspect of the fourth inventionis the operating system according to the first aspect of the fourthinvention, wherein the apparatus management device further includes afirst information transmission unit. The first information transmissionunit transmits the first information to the infrared output device.

With the operating system, when the first information is transmittedfrom the apparatus management device to the infrared output device, aninfrared signal corresponding to the first information is transmitted tothe apparatus to be operated. In other words, the operation of theinfrared output device to transmit a signal is controlled by theapparatus management device of the air conditioner. Since the infraredoutput device is installed in the indoor unit or near the indoor unit,the operating system can be implemented almost without wiring work forinstalling the infrared output device.

An operating system according to a third aspect of the fourth inventionis the operating system according to the second aspect of the fourthinvention, wherein the first information transmission unit, when thedetermination unit determines that there is the inconsistency,retransmits the first information to the infrared output device.

With the operating system, when the actual behavior of the apparatus tobe operated is inconsistent with the operation content in the command,the first information is resent, and, as a result, the infrared signalcorresponding to the first information is resent from the infraredoutput device to the apparatus to be operated. Therefore, the operationfailed state is hardly left as it is.

An operating system according to a fourth aspect of the fourth inventionis the operating system of any one of the first to third aspects of thefourth invention, wherein the infrared output device is mounted in theindoor unit.

Here, the infrared output device is mounted in the indoor unit.Therefore, work for connecting the infrared output device and the indoorunit on site is not required.

An operating system according to a fifth aspect of the fourth inventionis the operating system according to any one of the first to fourthaspects of the fourth invention, and further includes an operationalstatus detecting unit. The operational status detecting unit detects anoperational status of the apparatus to be operated. The apparatusmanagement device further includes a judging unit. The judging unitjudges a behavior of the apparatus to be operated based on theoperational status that is detected by the operational status detectingunit.

An apparatus to be operated with infrared ray mostly has no output unitthat outputs a behavior to the outside. However, the operating systemincludes the operational status detecting unit to detect the operationalstatus of the apparatus to be operated, and the behavior of theapparatus to be operated is judged based on the detected operationalstatus. Therefore, even an apparatus to be operated does not have anoutput unit, or the like, that outputs a behavior can be managed by theapparatus management device.

An operating system according to a sixth aspect of the fourth inventionis the operating system according to the fifth aspect of the fourthinvention, wherein the operational status detecting unit includes atleast one of a microphone, a camera, a sensor configured to measure acurrent or electric power, an illuminance sensor, a temperature sensor,and a barometric sensor.

Here, the operational status detecting unit acquires an operating soundof the apparatus to be operated or a notification sound at the time ofreceiving an infrared signal with the microphone, detects the behaviorof the apparatus to be operated with the camera, or measures variousstate quantities with various sensors. Thus, the operational status ofthe apparatus to be operated can be accurately acquired.

An operating system according to a seventh aspect of the fourthinvention is the operating system according to any one of the first tosixth aspects of the fourth invention, wherein the apparatus managementdevice further includes an output unit. The output unit outputsinformation about a result determined by the determination unit.

With the operating system, information about the result determined bythe determination unit is output. Therefore, the state (operation failedstate) of the apparatus to be operated, where the operation content inthe command is inconsistent with an actual behavior, is hardly left asit is.

An operating system according to an eighth aspect of the fourthinvention is the operating system according to any one of the first toseventh aspects of the fourth invention, and further includes a commandreceiver. The command receiver receives a command to the apparatus to beoperated as a voice command and transmits a signal on the voice commandto an analyzing device that analyzes the signal via a network. The firstinformation is information based on an analyzed result of the signal bythe analyzing device.

The apparatus to be operated can be operated by voice, so convenience ishigh.

Advantageous Effects of Invention First Invention

With the operating system according to the first aspect of the firstinvention, a any apparatus can be controlled.

With the operating system according to the second aspect of the firstinvention, a any apparatus around the operating device can becontrolled.

With the operating system according to the third aspect of the firstinvention, the system can be appropriately managed.

With the operating system according to the fourth aspect of the firstinvention, the reliability of the system is improved.

With the operating system according to the fifth aspect of the firstinvention, the reliability of the system is improved.

With the operating system according to the sixth aspect of the firstinvention, extensibility to the first-type apparatus is improved.

With the operating system according to the seventh aspect of the firstinvention, multiple-model first-type apparatuses can be controlled.

With the operating system according to the eighth aspect of the firstinvention, the system configuration is simplified.

With the operating system according to the ninth aspect of the firstinvention, the first-type apparatus and the second-type apparatus can becontrolled by voice input.

With the operating system according to the tenth aspect of the firstinvention, the apparatus can be controlled without access to theinformation processing device on the network.

With the operating system according to the eleventh aspect of the firstinvention, the apparatus can be appropriately controlled according to anenvironment of a user.

With the operating system according to the twelfth aspect of the firstinvention, comfort of a user is improved.

With the operating system according to the thirteenth aspect of thefirst invention, a user is caused to recognize a specific situation.

With the operating system according to the fourteenth aspect of thefirst invention, the operating system with high extensibility can beprovided.

With the operating system according to the fifteenth aspect of the firstinvention, the operating system with high extensibility can be provided.

With the operating system according to the sixteenth aspect of the firstinvention, the operating system can be further appropriately managed.

With the operating system according to the seventeenth aspect of thefirst invention, the apparatus can be appropriately controlled accordingto an environment of a user.

With the second information processing device according to theeighteenth aspect of the first invention, an operating system that cancontrol any apparatus can be constructed.

With the second information processing device according to thenineteenth aspect of the first invention, the reliability of the systemis improved.

With the second information processing device according to the twentiethaspect of the first invention, extensibility to the first-type apparatusis improved.

With the second information processing device according to thetwenty-first aspect of the first invention, multiple-model first-typeapparatuses can be controlled.

With the second information processing device according to thetwenty-second aspect of the first invention, the first-type apparatusand the second-type apparatus can be controlled by voice input.

With the second information processing device according to thetwenty-third aspect of the first invention, the apparatus can beappropriately controlled according to an environment of a user.

With the second information processing device according to thetwenty-fourth aspect of the first invention, comfort of a user isimproved.

With the second information processing device according to thetwenty-fifth aspect of the first invention, a user is caused torecognize a specific situation.

With the second information processing device according to thetwenty-sixth aspect of the first invention, the apparatus can beappropriately controlled according to an environment of a user.

With the second information processing device according to thetwenty-seventh aspect of the first invention, an operating system thatcan control any apparatus can be constructed.

Second Invention

With the control system according to the first aspect of the secondinvention, any controlled apparatus can be easily controlled by voiceinput.

With the control system according to the second aspect of the secondinvention, the probability that infrared ray reaches a controlledapparatus can be increased.

With the control system according to the third aspect of the secondinvention, a controlled apparatus present at a location lower than alocation where an air-conditioning device is installed can be easilycontrolled.

With the control system according to the fourth aspect of the secondinvention, infrared ray can be output from a higher position.

With the control system according to the fifth aspect of the secondinvention, the system configuration is simplified.

With the control system according to the sixth aspect of the secondinvention, the probability that infrared ray reaches a controlledapparatus can be increased.

With the control system according to the seventh aspect of the secondinvention, any apparatus can be easily controlled by voice input.

With the infrared output device according to the eighth aspect of thesecond invention, a controlled apparatus can be easily controlled byvoice input.

Third Invention

With the control system according to the first aspect of the thirdinvention, the control system with high reliability can be provided.

With the control system according to the second aspect of the thirdinvention, reliability is further improved.

With the control system according to the third aspect of the thirdinvention, reliability is further improved.

With the control system according to the fourth aspect, the probabilitythat infrared ray reaches a controlled apparatus can be increased.

With the information processing device according to the fifth aspect ofthe third invention, a control system with high reliability can beconstructed.

Fourth Invention

With the operating system according to the first aspect of the fourthinvention, the apparatus management device of the air conditionerdetermines whether an actual behavior of the apparatus to be operated isinconsistent with a command content to the apparatus to be operated.Therefore, the state where the actual behavior is inconsistent with thecommand content (operation failed state) is hardly left as it is.

With the operating system according to the second and fourth aspects ofthe fourth invention, wiring work during installation is reduced.

With the operating system according to the third and seventh aspects ofthe fourth invention, the state where an actual behavior of theapparatus to be operated is inconsistent with an operation content inthe command is hardly left as it is.

With the operating system according to the fifth aspect of the fourthinvention, even an apparatus to be operated without an output unit, orthe like, configured to output a behavior can be managed by theapparatus management device.

With the operating system according to the sixth aspect of the fourthinvention, the operational status of the apparatus to be operated can beaccurately acquired.

With the operating system according to the seventh aspect of the fourthinvention, the air conditioner can be operated by voice even when theair conditioner is caused to perform a relatively complicated operation.

With the operating system according to the eighth aspect of the fourthinvention, the apparatus to be operated can be operated by voice, soconvenience is high.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram that shows the concept of an operatingsystem 1001 according to a first embodiment of the first invention.

FIG. 2 is a schematic diagram that shows the configuration of theoperating system 1001 according to the embodiment.

FIG. 3 is a schematic diagram that shows the configuration of anoperating device 1050 according to the embodiment.

FIG. 4 is a schematic diagram that shows the configuration of a firstinformation processing device 1100 according to the embodiment.

FIG. 5 is a schematic diagram that shows the configuration of a secondinformation processing device 1200 according to the embodiment.

FIG. 6 is a sequence diagram for illustrating the operation of theoperating system 1001 according to the embodiment.

FIG. 7 is a sequence diagram for illustrating the operation of theoperating system 1001 according to the embodiment.

FIG. 8 is a sequence diagram for illustrating the operation of theoperating system 1001 according to the embodiment.

FIG. 9 is a schematic diagram that shows the configuration of anoperating system according to a modification 1F.

FIG. 10 is a schematic diagram that shows the configuration of theoperating device 1050 according to the modification 1F.

FIG. 11 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1F.

FIG. 12 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1F.

FIG. 13 is a schematic diagram that shows the configuration of theoperating system 1001 according to a modification 1G.

FIG. 14 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1G.

FIG. 15 is a schematic diagram that shows the configuration of theoperating system 1001 according to a modification 1H.

FIG. 16 is a schematic diagram that shows the configuration of thesecond information processing device 1200 according to the modification1H.

FIG. 17 is a schematic diagram that shows the configuration of anassociated apparatus storage unit 1240 according to the modification 1H.

FIG. 18 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1H.

FIG. 19 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1H.

FIG. 20 is a schematic diagram that shows the configuration of theoperating system 1001 according to a modification 1I.

FIG. 21 is a schematic diagram that shows the configuration of thesecond information processing device 1200 according to the modification1I.

FIG. 22 is a sequence diagram that shows the operation of the operatingsystem 1001 according to the modification 1I.

FIG. 23 is a schematic diagram that shows the concept of an operatingsystem 1001S according to a second embodiment of the first invention.

FIG. 24 is a schematic diagram that shows the concept of the operatingsystem 1001S according to the embodiment.

FIG. 25A is a sequence diagram for illustrating the operation of theoperating system 1001S according to the embodiment.

FIG. 25B is a sequence diagram for illustrating the operation of theoperating system 1001S according to the embodiment.

FIG. 26A is a sequence diagram that shows the operation of the operatingsystem 1001S according to a modification 2A.

FIG. 26B is a sequence diagram that shows the operation of the operatingsystem 1001S according to the modification 2A.

FIG. 27 is a schematic diagram that shows the configuration of theoperating system 1001S according to a modification 2B.

FIG. 28 is a schematic diagram that shows the configuration of a secondinformation processing device 1200S according to the modification 2B.

FIG. 29 is a schematic diagram that shows the configuration of anassociated apparatus storage unit 1240S according to the modification2B.

FIG. 30A is a sequence diagram that shows the operation of the operatingsystem 1001S according to the modification 2B.

FIG. 30B is a sequence diagram that shows the operation of the operatingsystem 1001S according to the modification 2B.

FIG. 31A is a sequence diagram that shows the operation of the operatingsystem 1001S according to the modification 2B.

FIG. 31B is a sequence diagram that shows the operation of the operatingsystem 1001S according to the modification 2B.

FIG. 32 is a schematic diagram that shows the configuration of a secondinformation processing device 1200T according to a third embodiment ofthe first invention.

FIG. 33 is a sequence diagram for illustrating the operation of anoperating system 1001T according to the embodiment.

FIG. 34 is a schematic diagram that shows the configuration of a secondinformation processing device 1200V according to a fourth embodiment ofthe first invention.

FIG. 35A is a sequence diagram for illustrating the operation of anoperating system 1001V according to the embodiment.

FIG. 35B is a sequence diagram for illustrating the operation of theoperating system 1001V according to the embodiment.

FIG. 36 is a schematic diagram that shows the configuration of a controlsystem 2001 according to a first embodiment of the second invention.

FIG. 37 is a schematic diagram that shows the configuration of thecontrol system 2001 according to the embodiment.

FIG. 38 is a schematic diagram that shows the configuration of aninformation processing device 2100 according to the embodiment.

FIG. 39A is a sequence diagram for illustrating the operation of thecontrol system 2001 according to the embodiment.

FIG. 39B is a sequence diagram for illustrating the operation of thecontrol system 2001 according to the embodiment.

FIG. 40 is a schematic diagram that shows an example of a fixedapparatus (air-conditioning device 2020 d) according to the embodiment.

FIG. 41 is a schematic diagram that shows the configuration of thecontrol system 2001 according to a modification 3A.

FIG. 42 is a schematic diagram that shows the configuration of thecontrol system 2001 according to a modification 3B.

FIG. 43 is a schematic diagram that shows the configuration of a controlsystem 2001S according to a second embodiment of the present invention.

FIG. 44 is a schematic diagram that shows the configuration of aninfrared output device 2070S according to the embodiment.

FIG. 45 is a schematic diagram that shows the configuration of amodification of the control system 2001S according to the embodiment.

FIG. 46 is a schematic diagram that shows the configuration of amodification of the infrared output device 2070S according to theembodiment.

FIG. 47 is a schematic diagram that shows the configuration of a controlsystem 3001 according to a first embodiment of the third invention.

FIG. 48 is a schematic diagram that shows the configuration of thecontrol system 3001 according to the embodiment.

FIG. 49 is a schematic diagram that shows the configuration of aninformation processing device 3100 according to the embodiment.

FIG. 50A is a sequence diagram for illustrating the operation of thecontrol system 3001 according to the embodiment.

FIG. 50B is a sequence diagram for illustrating the operation of thecontrol system 3001 according to the embodiment.

FIG. 51 is a schematic diagram that shows the configuration of thecontrol system 3001 according to the embodiment.

FIG. 52 is a schematic diagram that shows the configuration of theinformation processing device 3100 according to the embodiment.

FIG. 53A is a sequence diagram for illustrating the operation of thecontrol system 3001 according to the embodiment.

FIG. 53B is a sequence diagram for illustrating the operation of thecontrol system 3001 according to the embodiment.

FIG. 54 is a schematic diagram that shows a modification of the controlsystem 3001 according to the embodiment.

FIG. 55 is a schematic diagram that shows a modification of the controlsystem 3001 according to the embodiment.

FIG. 56 is a schematic configuration diagram of an equipment systemaccording to one embodiment of the fourth invention.

FIG. 57 is a schematic block diagram of the equipment system accordingto the embodiment, and, in FIG. 57, part of components of the equipmentsystem are not shown.

FIG. 58A is a schematic diagram of a state where a wall-hanging indoorunit of an air conditioner and an infrared output device are installedin an operating system according to the embodiment.

FIG. 58B is a schematic diagram of a state where a ceiling-concealedindoor unit of an air conditioner and an infrared output device areinstalled in the operating system according to the embodiment.

FIG. 59 is a flowchart that illustrates the operation of an apparatusmanagement device when an apparatus of a first apparatus group isoperated according to the embodiment.

FIG. 60 is an example of a list of a command content to an apparatus anda behavior of the apparatus for each apparatus, stored in a storage unitof the apparatus management device of the air conditioner according tothe embodiment.

FIG. 61 is a schematic block diagram of an operating system of amodification 4E, and, in FIG. 61, part of components of the operatingsystem are not shown.

DESCRIPTION OF EMBODIMENTS First Invention First Embodiment (1-1-1)Configuration of Operating System 1001

FIG. 1 is a schematic diagram that shows the concept of an operatingsystem 1001 according to a first embodiment of the first invention. FIG.2 is a schematic diagram that shows the configuration of the operatingsystem 1001 according to the embodiment.

The operating system 1001 includes an operating device 1050, a firstinformation processing device 1100, and a second information processingdevice 1200. The operating device 1050 includes an input receivingdevice 1060 and an infrared output device 1070. In the operating system1001, when a user 1005 performs an input operation on the operatingdevice 1050, an apparatus present around the operating device 1050 canbe operated. Here, “first-type apparatuses 1010” and “second-typeapparatuses 1020” are present as types of apparatuses. These apparatusesare placed in a building 1002.

In FIG. 1, one of each of the operating device 1050, the firstinformation processing device 1100, and the second informationprocessing device 1200 is shown; however, the number of each device isnot limited thereto. The first information processing device 1100 andthe second information processing device are connected to any number ofthe operating devices 1050 and are able to manage these operatingdevices 1050.

The first-type apparatuses 1010 are operable by at least communicationof an infrared pattern. Examples of the first-type apparatuses 1010include an electric fan 1010 a, a luminaire 1010 b, a television 1010 c,and an air conditioner 1010 d. In the following description, referencenumeral 1010 indicates any first-type apparatus, and a lower-casealphabet is suffixed to indicate an individual first-type apparatus.

The second-type apparatuses 1020 are operable via at least a network NW.Here, the second-type apparatuses 1020 are managed by the secondinformation processing device 1200. Examples of the second-typeapparatuses 1020, as well as the first-type apparatuses 1010, include anelectric fan 1020 a, a luminaire 1020 b, a television 1020 c, and an airconditioner 1020 d. In the following description, reference numeral 1020indicates any second-type apparatus, and a lower-case alphabet issuffixed to indicate an individual second-type apparatus.

As shown in FIG. 3, the operating device 1050 includes an input unit1051, an output unit 1052, a communication unit 1053, a storage unit1054, and a processing unit 1055, and functions as the input receivingdevice 1060 and the infrared output device 1070.

The input unit 1051 inputs information to the operating device 1050. Forexample, the input unit 1051 is a microphone, and the user 1005 isallowed to input information by voice (voice input). Various commandsare input to the operating device 1050 via the input unit 1021, andprocesses corresponding to the commands are executed by the processingunit 1055. The input unit 1051 may include, for example, a keyboard, amouse, and/or a touch screen. The output unit 1052 outputs variouspieces of information from the operating device 1050. For example, theoutput unit 1022 is a speaker, or the like. The output unit 1052 is ableto output infrared ray. Thus, the output unit 1052 is able to control asurrounding apparatus. The output unit 1052 may include not only thespeaker but also a display.

The communication unit 1053 is able to connect with the external networkNW.

Thus, the operating device 1050 is able to transmit or receiveinformation to or from the first information processing device 1100, thesecond information processing device 1200, and the like, via theInternet, or the like.

The storage unit 1054 stores information that is input to the operatingdevice 1050, information that is calculated by the operating device1050, and the like. For example, the storage unit 1054 is a ROM, a RAM,and the like. Here, the storage unit 1054 stores an “infrared patternstorage database (DB) 1054 a”. Information of an infrared pattern thatis set for each of the models of the first-type apparatuses 1010 presentaround the operating device 1050 is stored in the infrared patternstorage DB. The first-type apparatuses 1010 include a plurality ofmodels. An infrared pattern corresponding to a control instructionvaries among the models. The storage unit 1054 stores various programsfor implementing the functions of the processing unit 1055.

The processing unit 1055 executes information processing in theoperating device 1050. Specifically, the processing unit 1055 is made upof a CPU, a cache memory, and the like. When the processing unit 1055runs programs installed in the storage unit 1054, the operating device1050 functions as the “input receiving device 1060” and the “infraredoutput device 1070”.

As the input receiving device 1060 receives an input operation from theinput unit 1051, the input receiving device 1060 transmits operationinformation corresponding to the input operation to the firstinformation processing device 1100 via the communication unit 1053. Aninput operation can be input to the input receiving device 1060 byvoice. After a lapse of a predetermined time from an input operation,the input receiving device 1060 determines whether a second-typeapparatuses 1020 has been controlled by the second informationprocessing device 1200 and transmits a determined result to the firstinformation processing device 1100. The input receiving device 1060determines whether a first-type apparatuses 1010 has been controlledbased on an infrared pattern transmitted by the infrared output device1070 and transmits a determined result to the first informationprocessing device 1100 or the second information processing device 1200.

When the infrared output device 1070 has received an output instructionfrom the second information processing device 1200 (described later),the infrared output device 1070 reads an infrared pattern correspondingto the output instruction from the storage unit 1054 and outputs theinfrared pattern to the first-type apparatus 1010 present around theoperating device 1050. Thus, the first-type apparatus 1010 iscontrolled.

As shown in FIG. 4, the first information processing device 1100includes an input unit 1101, an output unit 1102, a communication unit1103, a storage unit 1104, and a processing unit 1105, and is connectedto the operating device 1050 and the second information processingdevice 1200 via the network NW. Here, the input unit 1101 inputs variouspieces of information to the first information processing device 1100.The output unit 1102 outputs various pieces of information from thefirst information processing device 1100. The communication unit 1103 isable to connect with the external network NW. The storage unit 1104stores information that is input to the first information processingdevice 1100, information that is calculated by the first informationprocessing device 1100, and the like. The processing unit 1105 executesinformation processing in the first information processing device 1100.When the processing unit 1105 runs programs installed in the storageunit 1104, the processing unit 1105 functions as an “operationinformation analyzing unit 1110”, a “control instruction determinationunit 1120”, and a “control checking unit 1130”.

The operation information analyzing unit 1110 is configured to analyzeoperation information corresponding to an input operation received fromthe operating device 1050. When voice input has been received from theoperating device 1050, voice information corresponding to voice input isanalyzed. Specifically, a meaning corresponding to the voice is analyzedby using neural network, or the like, and is converted from voiceinformation to text information. The converted text information istransmitted to the control instruction determination unit 1120.

The control instruction determination unit 1120 determines whether theresult analyzed by the operation information analyzing unit 1110contains a control instruction to a first-type apparatus 1010 or acontrol instruction to a second-type apparatus 1020. The analyzed resultis transmitted to the second information processing device 1200.

The control checking unit 1130 receives, from the input receiving device1060, a determined result as to whether a second-type apparatus 1020 hasbeen controlled by the second information processing device 1200. Whenthe control checking unit 1130 has received a determined result that asecond-type apparatus 1020 has not been controlled, the control checkingunit 1130 transmits the result analyzed by the operation informationanalyzing unit 1110 to the second information processing device 1200again.

As shown in FIG. 5, the second information processing device 1200includes an input unit 1201, an output unit 1202, a communication unit1203, a storage unit 1204, and a processing unit 1205, and is connectedto the operating device 1050 and the first information processing device1100 via the network NW. The input unit 1201 inputs various pieces ofinformation to the second information processing device 1200. The outputunit 1202 outputs various pieces of information from the secondinformation processing device 1200. The communication unit 1203 is ableto connect with the external network NW. The storage unit 1204 storesinformation that is input to the second information processing device1200, information that is calculated by the second informationprocessing device 1200, and the like. The processing unit 1205 executesinformation processing in the second information processing device 1200.When the processing unit 1205 runs programs installed in the storageunit 1204, the processing unit 1205 functions as a “first control unit1210”, a “second control unit 1220”, and a “control checking unit 1230”.

When the first control unit 1210 has received a result determined by thecontrol instruction determination unit 1120 from the first informationprocessing device 1100 and the determined result contains a controlinstruction to a first-type apparatus 1010, the first control unit 1210transmits an output instruction to the operating device 1050 (infraredoutput device 1070) via the communication unit 1203 to output aninfrared pattern corresponding to the control instruction to thefirst-type apparatus 1010.

When the second control unit 1220 has received a result determined bythe control instruction determination unit 1120 from the firstinformation processing device 1100 and the determined result contains acontrol instruction to a second-type apparatus 1020, the second controlunit 1220 controls the second-type apparatus 1020 via the network NWbased on the control instruction.

The control checking unit 1230 receives, from the input receiving device1060, the determined result as to whether a first-type apparatus 1010has been controlled by the first information processing device 1100.When the control checking unit 1230 has received a determined resultthat a first-type apparatus 1010 has not been controlled, the controlchecking unit 1230 transmits a result analyzed by the operationinformation analyzing unit 1110 to the infrared output device 1070again.

(1-1-2) Operation of Operating System 1001

FIG. 6 is a sequence diagram for illustrating the operation of theoperating system 1001 according to the present embodiment. In thefollowing description, for the sake of convenience, it is assumed that acontrolled apparatus A is present as a first-type apparatus 1010 and acontrolled apparatus B is present as a second-type apparatus 1020 aroundthe user 1005.

First, an input operation on an apparatus present around the user 1005is performed by the user 1005. Here, an operating command to thecontrolled apparatus A or the controlled apparatus B is input by theuser 1005 by voice (S1). For example, a command, such as “Turn on thepower of the controlled apparatus A” and “Turn off the controlledapparatus B”, is input by the user 1005 by voice.

Subsequently, the input receiving device 1060 receives the voice inputby the user 1005, converts the input voice to voice information, andtransmits the voice information to the first information processingdevice 1100 and the second information processing device 1200 (S2).

In the second information processing device 1200, the received voiceinformation is accumulated as needed (S3).

In the first information processing device 1100, the operationinformation analyzing unit 1110 analyzes the voice information receivedfrom the operating device 1050 (S4). For example, the operationinformation analyzing unit 1110 of the first information processingdevice 1100 analyzes the voice information by using neural network, orthe like. Here, the operation information analyzing unit 1110 of thefirst information processing device 1100 analyzes a meaningcorresponding to the voice information and converts the voiceinformation to text information.

Subsequently, the control instruction determination unit 1120 of thefirst information processing device 1100 determines whether the resultanalyzed by the operation information analyzing unit 1110 contains acontrol instruction to a first-type apparatus 1010 or a controlinstruction to a second-type apparatus 1020 (S5). When the firstinformation processing device 1100 determines that a control instructionto a first-type apparatus 1010 is contained (Yes in S5), the firstinformation processing device 1100 transmits the determined result tothe second information processing device 1200. Here, it is assumed thatthe analyzed result contains a control instruction to the controlledapparatus A that is a first-type apparatus.

After that, the second information processing device 1200 receives thedetermined result from the first information processing device 1100(S6), and determines a control content over the first-type apparatus1010 (controlled apparatus A) (S7). The first control unit 1210 of thesecond information processing device 1200 transmits an outputinstruction to the operating device 1050 (infrared output device 1070)via the communication unit 1203 to output an infrared patterncorresponding to the control instruction.

Subsequently, the infrared output device 1070 receives the outputinstruction from the second information processing device 1200, outputsan infrared pattern based on the output instruction (S8), and controlsthe controlled apparatus A that is a first-type apparatus 1010 (S9). Onthe other hand, when the first information processing device 1100determines in step S5 that a control instruction to a first-typeapparatus 1010 is not contained (No in S5), the first informationprocessing device 1100 determines whether a control instruction to asecond-type apparatus 1020 is contained (S10). When the firstinformation processing device 1100 determines that a control instructionto a second-type apparatus 1020 is contained (Yes in S10), the firstinformation processing device 1100 transmits the determined result tothe second information processing device 1200. Here, it is assumed thatthe analyzed result contains a control instruction to the controlledapparatus B that is a second-type apparatus 1020.

After that, the second information processing device 1200 receives thedetermined result from the first information processing device 1100(S11), and determines a control content over the second-type apparatus1020 (controlled apparatus B) (S12). The second control unit 1220 of thesecond information processing device 1200 controls the controlledapparatus B that is a second-type apparatus 1020 via the network NWbased on the control instruction (S13). When the first informationprocessing device 1100 determines in step S10 that a control instructionto a second-type apparatus 1020 (controlled apparatus B) is notcontained (No in S10), the operating system 1001 ends the process.

The processes of step S5 to step S9 and the processes of step S10 tostep S13 are not in particular order and any one of sets of theprocesses may be executed first.

(1-1-3) Characteristics

(1-1-3-1)

As described above, the operating system 1001 according to the presentembodiment includes the input receiving device 1060, the firstinformation processing device 1100, the second information processingdevice 1200, and the infrared output device 1070, and operates afirst-type apparatus 1010 operable by at least communication of aninfrared pattern and a second-type apparatus 1020 operable via at leastthe network NW. The input receiving device 1060 receives an inputoperation. The first information processing device 1100 is connected tothe input receiving device 1060 and includes the operation informationanalyzing unit 1110 that analyzes operation information corresponding tothe input operation. The first information processing device 1100includes the control instruction determination unit 1120 that determineswhether a result analyzed by the operation information analyzing unit1110 contains a control instruction to a first-type apparatus 1010(controlled apparatus A) or a control instruction to a second-typeapparatus 1020 (controlled apparatus B). The second informationprocessing device 1200 is connected to the first information processingdevice 1100. When the control instruction determination unit 1120determines that a control instruction to a second-type apparatus 1020(controlled apparatus B) is contained, the second information processingdevice 1200 controls the second-type apparatus 1020 (controlledapparatus B) via the network NW based on the control instruction. Theinfrared output device 1070 is connected to the first informationprocessing device 1100 or the second information processing device 1200.When the control instruction determination unit 1120 determines that acontrol instruction to a first-type apparatus 1010 (controlled apparatusA) is contained, the infrared output device 1070 outputs an infraredpattern corresponding to the control instruction to the first-typeapparatus 1010 (controlled apparatus A).

Therefore, with the operating system 1001 according to the presentembodiment, when it is determined that operation information contains acontrol instruction to a first-type apparatus as a result of analysis ofthe operation information, the first-type apparatus 1010 (controlledapparatus A) is controlled by transmission of an infrared pattern to thefirst-type apparatus 1010 (controlled apparatus A). On the other hand,when the operating system 1001 determines that the operation informationcontains a control instruction to a second-type apparatus 1020(controlled apparatus B) as a result of analysis of the operationinformation, the operating system controls the second-type apparatus1020 (controlled apparatus B) via the network NW. In other words, anapparatus not operable via the network NW (first-type apparatus 1010) isoperated by the infrared output device 1070, and an apparatus operablevia the network NW (second-type apparatus 1020) is operated by thesecond information processing device 1200. Therefore, any apparatusaround the operating device 1050 (input receiving device 1060) can becontrolled.

Particularly, with the operating system 1001 according to the presentembodiment, the operation information analyzing unit 1110 of the firstinformation processing device 1100 analyzes operation information inputby voice. Therefore, the operating system 1001 is able to control afirst-type apparatus 1010 and a second-type apparatus 1020 by voiceinput.

In the operating system 1001 according to the present embodiment, thesecond information processing device 1200 receives a result determinedby the control instruction determination unit 1120 from the firstinformation processing device 1100. When the determined result containsa control instruction to a first-type apparatus 1010 (controlledapparatus A), the second information processing device 1200 transmits anoutput instruction to the infrared output device 1070 to output aninfrared pattern corresponding to the control instruction to thefirst-type apparatus 1010 (controlled apparatus A).

In this way, the second information processing device 1200 transmits anoutput instruction to the infrared output device 1070. Therefore, in thesecond information processing device 1200, it can be judged whether thefirst-type apparatus 1010 (controlled apparatus A) has been controlled.As a result, the reliability of the operating system 1001 is improved.

(1-1-3-2)

The operating system 1001 according to the present embodiment includesthe operating device 1050 that accommodates the input receiving device1060 and the infrared output device 1070 in one and the same casing. Inthis way, since the input receiving device 1060 and the infrared outputdevice 1070 are accommodated in one and the same casing as the operatingdevice 1050, any apparatus around the operating device 1050 can becontrolled regardless of whether any apparatus is an apparatus operablevia the network NW (second-type apparatus 1020).

(1-1-3-3)

In the operating system 1001 according to the present embodiment, asshown in the sequence of FIG. 7, the input receiving device 1060 maydetermine whether the second-type apparatus 1020 has been controlled bythe second information processing device 1200 and transmit a determinedresult to the first information processing device 1100 (step S14 andstep S15). For example, the input receiving device 1060 determineswhether the second-type apparatus 1020 has been controlled based on, forexample, whether a surrounding apparatus has been operated within apredetermined time from transmission of voice information.

Thus, for example, even when an administrator of the first informationprocessing device 1100 is different from an administrator of the secondinformation processing device 1200, the administrator of the firstinformation processing device 1100 is able to judge whether thesecond-type apparatus 1020 (controlled apparatus B) has been controlledby the second information processing device 1200. As a result, theoperating system 1001 can be appropriately managed.

(1-1-3-4)

As shown in FIG. 8, in the operating system 1001 according to thepresent embodiment, after step S9, the input receiving device 1060 maydetermine whether the first-type apparatus 1010 has been controlled bycommunication of an infrared pattern and transmit a determined result tothe second information processing device 1200 (step S16 and step S17).

Thus, the administrator of the second information processing device 1200is able to judge whether the first-type apparatus 1010 (controlledapparatus A) has been controlled. When the determined result that thefirst-type apparatus 1010 has not been controlled has been received, thesecond information processing device 1200 is able to provide theinfrared output device 1070 with, for example, an instruction totransmit an infrared pattern again. As a result, the reliability of theoperating system 1001 is improved.

(1-1-3-5)

In the operating system 1001 according to the present embodiment, thefirst-type apparatuses 1010 include a plurality of models, and aninfrared pattern corresponding to a control instruction varies among themodels. With this configuration, multiple-model first-type apparatuses1010 can be controlled by using infrared patterns (exclusive commands)that vary among the models.

Such infrared patterns are stored in the storage unit 1054 of theoperating device 1050. Pieces of information of these infrared patternscan be updated as needed via the second information processing device1200.

(1-1-4) Modifications (1-1-4-1) Modification 1A

In the above description, the input receiving device 1060 and theinfrared output device 1070 are accommodated in one and the same casing.Alternatively, these devices may be accommodated in individual casings.Thus, the flexibility of the system configuration is improved.

(1-1-4-2) Modification 1B

In the above description, in the control system 1001 according to thepresent embodiment, the input receiving device 1060 determines whetherthe first-type apparatus 1010 has been controlled by transmission of aninfrared pattern and transmit a determined result to the secondinformation processing device 1200; however, the operating system 1001according to the present embodiment is not limited thereto. For example,the input receiving device 1060 may determine whether the first-typeapparatus 1010 has been controlled by transmission of an infraredpattern and transmit a determined result to the first informationprocessing device 1100 only or transmit a determined result to both thefirst information processing device 1100 and the second informationprocessing device 1200. With any configuration, the reliability of theoperating system 1001 is improved.

(1-1-4-3) Modification 1C

In the operating system 1001 according to the present embodiment, thesecond information processing device 1200 or the infrared output device1070 may further include an infrared pattern generating unit thatgenerates an infrared pattern corresponding to a control content over afirst-type apparatus 1010. With such a configuration, a desiredfirst-type apparatus 1010 can be controlled. As a result, extensibilityto a first-type apparatus 1010 is improved.

(1-1-4-4) Modification 1D

In the operating system 1001 according to the present embodiment, asecond-type apparatus 1020 may include the input receiving device 1060and/or the infrared output device 1070. Specifically, one of thesecond-type apparatuses 1020 present in the building 1002 may beconfigured to incorporate the operating device 1050. Thus, the systemconfiguration is simplified.

(1-1-4-5) Modification 1E

In the above description, an input operation is voice input; however,the operating system 1001 according to the present embodiment is notlimited thereto. Other than voice input, any input method can beemployed as an input operation.

(1-1-4-6) Modification 1F

FIG. 9 is a schematic diagram that shows the configuration of anoperating system according to a modification 1F. FIG. 10 is a schematicdiagram that shows the configuration of the operating device 1050according to the modification.

In the modification 1F, the storage unit 1054 of the operating device1050 functions as a specific operation storage unit 1061, and theprocessing unit 1055 of the operating device 1050 functions as aspecific operation information identifying unit 1062 and a specificoperation execution unit 1063.

The specific operation storage unit 1061 stores specific operationinformation in association with a specific operation. The specificoperation storage unit 1061 prestores voice information correspondingto, for example, “Turn on the power of the D-model electric fan 1020 a”,or the like, in association with a specific operation to turn on thepower of the D-model electric fan 1020 a.

The specific operation information identifying unit 1062 identifiesspecific operation information on a second-type apparatus 1020 withinoperation information corresponding to an input operation.

When specific operation information has been identified by the specificoperation information identifying unit 1072, the specific operationexecution unit 1063 executes a specific operation on a second-typeapparatus 1020.

FIG. 11 and FIG. 12 are sequence diagrams that show the operation of themodification 1F.

In the modification 1F, the above-described operation of step S1 to stepS13 is executed. Here, the operation of the following step V1 to step V3is added subsequent to step S2. In other words, the input receivingdevice 1060 converts voice input by the user 1005 to voice informationand then executes the process of “specific operation”.

In the process of “specific operation”, the specific operationinformation identifying unit 1062 identifies specific operationinformation on a second-type apparatus 1020 within the operationinformation corresponding to the input operation (V1). Here, thespecific operation information identifying unit 1062 identifies whetherthe operation information is specific operation information by comparingthe operation information with the information stored in the specificoperation storage unit 1061. Subsequently, when specific operationinformation has been identified by the specific operation informationidentifying unit 1062 (Yes in V1), the specific operation execution unit1063 executes a specific operation on a second-type apparatus 1020(controlled apparatus B) (V2, V3). On the other hand, when specificoperation information has not been identified by the specific operationinformation identifying unit 1062 (No in V1), the specific operationexecution unit 1063 ends the process and returns to the process of stepS4.

As described above, with the operating system 1001 according to themodification 1F, when the input receiving device 1060 has identifiedspecific operation information on a second-type apparatus 1020(controlled apparatus B), the input receiving device 1060 executes aspecific operation on the second-type apparatus 1020 (controlledapparatus B). Therefore, the second-type apparatus 1020 (controlledapparatus B) can be controlled without access to the first informationprocessing device 1100 or the second information processing device 1200on the network NW.

Supplementarily, an apparatus is intended to be controlled by voiceinput, the amount of information processing is enormous. For thisreason, a voice analyzing device on the network NW can be used. Incontrast to this, with the modification 1F, an analyzing process isexecuted at a terminal side (input receiving device 1060) on, forexample, voice analysis whose load of the amount of informationprocessing is low. Thus, a quick operation on an apparatus isimplemented by avoiding access to the network NW.

(1-1-4-7) Modification 1G

FIG. 13 is a schematic diagram that shows the configuration of anoperating system according to a modification 1G. FIG. 14 is a sequencediagram that shows the operation of the modification 1G. In themodification 1G, the operation of step U1 and step U2 is added to theabove-described operation of step S1 to step S13, and step S7 and stepS12 are replaced with step U3 and step U4.

In the modification 1G, an environmental information detecting apparatusK is present around the controlled apparatuses A, B. The environmentalinformation detecting apparatus K is a second-type apparatus 1020 k, anddetects “environmental information” that indicates the status of asurrounding environment (U1). Environmental information containsinformation, such as temperature, humidity, and illuminance.

In the modification 1G, the processing unit 1205 of the secondinformation processing device 1200 further functions as an environmentalinformation acquiring unit 1241. The environmental information acquiringunit 1241 acquires environmental information at predetermined timingfrom the environmental information detecting apparatus K (U2).

The second information processing device 1200 according to themodification 1G receives a result determined by the control instructiondetermination unit 1120 from the first information processing device1100 and, when the determined result contains a control instruction to afirst-type apparatus 1010 (controlled apparatus A), transmits an outputinstruction to the infrared output device 1070 to output an infraredpattern based on the control instruction and the environmentalinformation (U3). In response to this, the infrared output device 1070controls the first-type apparatus 1010 (controlled apparatus A). Whenthe second information processing device 1200 determines that thedetermined result contains a control instruction to a second-typeapparatus 1020 (controlled apparatus B), the second informationprocessing device 1200 controls the second-type apparatus 1020(controlled apparatus B) via the network based on the controlinstruction and the environmental information (U4).

With the operating system 1001 according to the above-describedmodification 1G, an apparatus is controlled based on the controlinstruction and the environmental information. Therefore, an apparatuscan be appropriately controlled according to an environment of the user1005.

(1-1-4-8) Modification 1H

FIG. 15 is a schematic diagram that shows the configuration of anoperating system according to a modification 1H. FIG. 16 is a schematicdiagram that shows the configuration of the second informationprocessing device 1200 according to the modification 1H.

In the modification 1H, the environmental information detectingapparatus K is present around the controlled apparatuses A, B. Theenvironmental information detecting apparatus K is a second-typeapparatus 1020 k, and detects environmental information that indicatesthe status of a surrounding environment.

In the modification 1H, the storage unit 1204 of the second informationprocessing device 1200 functions as an associated apparatus storage unit1240, and the processing unit 1205 of the second information processingdevice 1200 further functions as an environmental information acquiringunit 1241, an associated apparatus extracting unit 1242, and anassociated apparatus control unit 1243.

The associated apparatus storage unit 1240 stores any one or anycombination of another first-type apparatus 1010 r (associated apparatusD) or another second-type apparatus 1020 r (associated apparatus E) asan associated apparatus in association with any one of a first-typeapparatus 1010 (controlled apparatus A) and a second-type apparatus 1020(controlled apparatus B) and environmental information. For example, asshown in FIG. 17, the associated apparatus storage unit 1240 stores an“S-model luminaire” that is a first-type apparatus 1010 r as anassociated apparatus (associated apparatus D) in association with“illuminance information” that is environmental information and an“S-model television” that is a first-type apparatus 1010 (controlledapparatus A). For example, the associated apparatus storage unit 1240stores a “D-model electric fan” that is a first-type apparatus 1010 r asan associated apparatus in association with “temperature information”that is environmental information and an “H-model air conditioner” thatis a second-type apparatus 1020 (controlled apparatus B). For example,the associated apparatus storage unit 1240 stores a “C-model farinfrared heater” that is a first-type apparatus 1010 r and a “D-modelfar infrared heater” that is a second-type apparatus 1020 r asassociated apparatuses in association with “temperature information”that is environmental information and a “D-model air conditioner” thatis a second-type apparatus 1020 (controlled apparatus B).

The environmental information acquiring unit 1241 acquires“environmental information” at predetermined timing from theenvironmental information detecting apparatus K. Environmentalinformation contains information, such as temperature, humidity, andilluminance.

When the control instruction determination unit 1120 of the firstinformation processing device 1100 determines that a control instructionto a first-type apparatus 1010 or a control instruction to a second-typeapparatus 1020 is contained, the associated apparatus extracting unit1242 extracts an associated apparatus(es) from the associated apparatusstorage unit 1240.

When another first-type apparatus 1010 r is extracted as an associatedapparatus (associated apparatus D) by the associated apparatusextracting unit 1242, the associated apparatus control unit 1243transmits an output instruction toward the extracted associatedapparatus (associated apparatus D) to the infrared output device 1070.When another second-type apparatus 1020 r is extracted as an associatedapparatus (associated apparatus E) by the associated apparatusextracting unit 1242, the associated apparatus control unit 1243controls the extracted associated apparatus (associated apparatus E) viathe network NW.

FIG. 18 and FIG. 19 are sequence diagrams that show the operation of themodification 1H. In the modification 1H, the above-described operationof step S1 to step S6, step S8 to step S11, step S13, and step U1 tostep U4 is executed. Here, the process of “control over the associatedapparatus(es)” of the following step R1 to step R8 is added between stepS6 and step U3 and between step S11 and step U4.

In the process of “control over the associated apparatus(es)”, when thecontrol instruction determination unit 1120 of the first informationprocessing device 1100 determines that a control instruction to afirst-type apparatus 1010 (controlled apparatus A) or a controlinstruction to a second-type apparatus 1020 (controlled apparatus B) iscontained, the associated apparatus extracting unit 1242 of the secondinformation processing device 1200 extracts an associated apparatus(es)(associated apparatuses D, E) from the associated apparatus storage unit1240 (R1).

When another first-type apparatus 1010 r is extracted as an associatedapparatus (associated apparatus D) by the associated apparatusextracting unit 1242 (Yes in R2), the associated apparatus control unit1243 of the second information processing device 1200 transmits anoutput instruction toward the extracted associated apparatus (associatedapparatus D) to the infrared output device 1070 (R3). In response tothis, the infrared output device 1070 outputs an infrared pattern to thefirst-type apparatus 1010 r (associated apparatus D) and controls thefirst-type apparatus 1010 r (associated apparatus D) (R4, R5).

On the other hand, when another first-type apparatus 1010 r is notextracted as an associated apparatus (associated apparatus D) by theassociated apparatus extracting unit 1242 (No in R2), the associatedapparatus control unit 243 of the second information processing device1200 proceeds to the process of step R6. In the process of step R6, whenanother second-type apparatus 1020 r is extracted as an associatedapparatus (associated apparatus E) by the associated apparatusextracting unit 1242 (Yes in R6), the associated apparatus control unit1243 of the second information processing device 1200 controls theextracted associated apparatus (associated apparatus E) via the networkNW (R7, R8). When another second-type apparatus 1020 r is not extractedas an associated apparatus (associated apparatus E) by the associatedapparatus extracting unit 1242 (Yes in R6), the process is ended.

The processes of step R2 to step R5 and the processes of step R6 to stepR8 are not in particular order and any one of sets of the processes maybe executed first.

In the operating system 1001 according to the above-describedmodification 1H, the second information processing device 1200 furtherincludes the environmental information acquiring unit 1241, theassociated apparatus storage unit 1240, the associated apparatusextracting unit 1242, and the associated apparatus control unit 1243.The environmental information acquiring unit 1241 acquires environmentalinformation at predetermined timing from the environmental informationdetecting apparatus K that detects environmental information thatindicates the status of a surrounding environment. The associatedapparatus storage unit 1240 stores any one or any combination of anotherfirst-type apparatus 1010 r (associated apparatus D) or anothersecond-type apparatus 1020 r (associated apparatus E) as an associatedapparatus in association with any one of a first-type apparatus 1010(controlled apparatus A) and a second-type apparatus 1020 (controlledapparatus B) and environmental information. When the control instructiondetermination unit 1120 determines that a control instruction to afirst-type apparatus 1010 (controlled apparatus A) or a controlinstruction to a second-type apparatus 1020 (controlled apparatus B) iscontained, the associated apparatus extracting unit 1242 extracts anassociated apparatus(es) (the associated apparatus D and the associatedapparatus E) from the associated apparatus storage unit 1240. Whenanother first-type apparatus 1010 r is extracted as an associatedapparatus (associated apparatus D) by the associated apparatusextracting unit 1242, the associated apparatus control unit 1243transmits an output instruction to the infrared output device 1070 tooutput an infrared pattern corresponding to a control content over theextracted associated apparatus to the associated apparatus (associatedapparatus D). When another second-type apparatus 1020 r is extracted asan associated apparatus (associated apparatus E) by the associatedapparatus extracting unit 1242, the associated apparatus control unit1243 controls the extracted associated apparatus (associated apparatusE) via the network NW.

Thus, with the operating system 1001 according to the modification 1H,not only a first-type apparatus 1010 (controlled apparatus A) or asecond-type apparatus 1020 (controlled apparatus B) but also associatedapparatuses (the associated apparatus D and the associated apparatus E)are controlled according to an environment of the user 1005. Therefore,comfort of the user 1005 is improved.

(1-1-4-9) Modification 1I

FIG. 20 is a schematic diagram that shows the configuration of anoperating system according to a modification 1I. FIG. 21 is a schematicdiagram that shows the configuration of the second informationprocessing device 1200 according to the modification 1I. FIG. 22 is asequence diagram that shows the operation of the modification 1I. In themodification 1I, in addition to the above-described operation of step S1to step S13, “control in a specific situation” as shown in step Q1 tostep Q5 is executed.

In the modification 1I, the storage unit 1204 of the second informationprocessing device 1200 functions as a specific situation storage unit1250, and the processing unit 1205 of the second information processingdevice 1200 further functions as a specific situation detecting unit1251 and a specific situation control unit 1252.

The specific situation storage unit 1250 stores a specific situation inassociation with a predetermined first-type apparatus 1010 t and acontrol content over the first-type apparatus 1010 t. In addition, thespecific situation storage unit 1250 stores a specific situation inassociation with a predetermined second-type apparatus 1020 t and acontrol content over the second-type apparatus 1020 t. For example, whenthe specific situation is “tsunami (seismic sea wave)”, the specificsituation storage unit 1250 sets the predetermined first-type apparatus1010 t for “S-model television” and stores “S-model television” inassociation with a control content that “Air a state-run program”. Forexample, when the specific situation is “tsunami”, the specificsituation storage unit 1250 sets the second-type apparatus 1020 t for“D-model air conditioner” and stores “D-model air conditioner” inassociation with a control content that “Turn off the power”.

The specific situation detecting unit 1251 detects a specific situation(Q1). Examples of the specific situation include tsunami, terrorism, andmajor earthquake.

When a specific situation has been detected (Yes in Q1), the specificsituation control unit 1252 transmits an output instruction to theinfrared output device 1070 to output an infrared pattern correspondingto a control content associated with the specific situation to apredetermined first-type apparatus 1010 t (controlled apparatus A)regardless of operation information (Q2). Thus, the infrared outputdevice 70 outputs the infrared pattern and controls the predeterminedfirst-type apparatus 1010 t (controlled apparatus A) (Q3, Q4). When aspecific situation has been detected (Yes in Q1), the specific situationcontrol unit 1272 controls a predetermined second-type apparatus 1020 t(controlled apparatus B) in accordance with a control content associatedwith the specific situation regardless of operation information (Q2,Q5).

In the operating system 1001 according to the above-describedmodification 1I, when a specific situation has been detected, afirst-type apparatus 1010 t (controlled apparatus A) associated with thespecific situation operates to make the user 1005 recognize the specificsituation. Depending on the type of a first-type apparatus 1010 t, thefirst-type apparatus 1010 t is controlled so as to ensure safety in aspecific situation. In addition, when a specific situation has beendetected, a second-type apparatus 1020 t (controlled apparatus B) iscontrolled in accordance with a control content associated with thespecific situation. Therefore, the user 1005 is made to recognize thespecific situation. Depending on the type of a second-type apparatus1020 t, the second-type apparatus 1020 t is controlled so as to ensuresafety in a specific situation. Specifically, regardless of a first-typeapparatus 1010 t or a second-type apparatus 1020 t, when an apparatus is“television”, “a state-run program or another program is aired” to makethe user 1005 recognize a specific situation. Regardless of a first-typeapparatus 1010 t or a second-type apparatus 1020 t, when an apparatus is“air conditioner”, the apparatus is controlled so as to ensure safety ina specific situation by “turning off the power”.

(1-1-4-10) Modification 1J

In the above description, the second information processing device 1200receives a content of a control instruction from the first informationprocessing device 1100 and transmits a control instruction to theinfrared output device 1070; however, the configuration of the operatingsystem 1001 according to the present embodiment is not limited thereto.Specifically, the first information processing device 1100 may beconfigured to directly transmit a control instruction to the infraredoutput device 1070.

Second Embodiment (1-2-1) Configuration of Operating System 1001S

FIG. 23 is a schematic diagram that shows the concept of an operatingsystem 1001S according to a second embodiment of the first invention.FIG. 24 is a schematic diagram that shows the configuration of theoperating system 1S according to the embodiment. In the followingdescription, like reference numerals denote the already describedcomponents, and the description will not be repeated. In the presentembodiment, components different from those of the other embodiments canbe described with a suffix “S”.

The operating system 1001S includes the operating device 1050, a firstinformation processing device 1100S, and a second information processingdevice 1200S. The operating device 1050 includes the input receivingdevice 1060 and the infrared output device 1070. The first informationprocessing device 1100S and second information processing device 1200Sof the operating system 1015 are connected to a third informationprocessing device 13005 via the network NW. With this operating system1001S, when the user 1005 performs an input operation on the operatingdevice 1050, the user 1005 is able to operate apparatuses present aroundthe operating device 1050. Here, the apparatuses include “first-typeapparatuses 1010”, “second-type apparatuses 1020”, and “third-typeapparatuses 1030”. These apparatuses are placed in the building 1002.

The third-type apparatuses 1030 are operable via at least the networkNW. Here, the third-type apparatuses 1030 are managed by the thirdinformation processing device 1300S. Examples of the third-typeapparatuses 1030, as well as the first-type apparatuses 1010 and thesecond-type apparatuses 1020, include an electric fan 1030 a, aluminaire 1030 b, a television 1030 c, and an air conditioner 1030 d. Inthe following description, reference numeral 1030 indicates anythird-type apparatus, and a lower-case alphabet is suffixed to indicatean individual third-type apparatus.

The second information processing device 1200S and the second-typeapparatuses 1020 are connected via a communication adaptor 1007A thatcommunicates under a first communication protocol. The third informationprocessing device 1300S and the third-type apparatuses 1030 areconnected via a communication adaptor 1007B that communicates under asecond communication protocol different from the first communicationprotocol.

In the second embodiment, a control instruction determination unit 11205of the first information processing device 1100S further determineswhether a result analyzed by the operation information analyzing unit1110 contains a control instruction to a control instruction to athird-type apparatus 1030. When the control instruction determinationunit 1120S determines that a control instruction to a third-typeapparatus 1030 is contained, the control instruction determination unit11205 transmits an operation command corresponding to the controlinstruction to the third information processing device 1300S.

(1-2-2) Operation of Operating System 1001S

FIG. 25A and FIG. 25B are sequence diagrams for illustrating theoperation of the operating system 1001S according to the presentembodiment. In the following description, for the sake of convenience,it is assumed that a controlled apparatus A is present as a first-typeapparatus 1010, a controlled apparatus B is present as a second-typeapparatus 1020, and a controlled apparatus C is present as a third-typeapparatus 1030 around the user 1005.

First, voice input on an apparatus present around the user 1005 isperformed by the user 1005 (W1). For example, a command, such as “Turnon the power of the controlled apparatus A” and “Turn off the controlledapparatus B”, is input by voice.

Subsequently, the input receiving device 1060 receives the voice inputperformed by the user 1005, converts the input voice to voiceinformation, and transmits the voice information to the firstinformation processing device 1100S and the second informationprocessing device 1200S (W2).

In the second information processing device 1200S, the voice informationis accumulated as needed (W3).

In the first information processing device 1100S, the operationinformation analyzing unit 1110 analyzes the voice information receivedfrom the operating device 1050 (W4). For example, the operationinformation analyzing unit 1110 of the first information processingdevice 1100S analyzes the voice information by using neural network, orthe like. The operation information analyzing unit 1110 of the firstinformation processing device 1100S analyzes a meaning corresponding tothe voice information and converts the voice information to textinformation.

Subsequently, the control instruction determination unit 1120 of thefirst information processing device 1100S determines whether a resultanalyzed by the operation information analyzing unit 1110 contains acontrol instruction to a first-type apparatus 1010 (W5). When the firstinformation processing device 1100S determines that a controlinstruction to a first-type apparatus 1010 (controlled apparatus A) iscontained (Yes in W5), the first information processing device 1100Stransmits the determined result to the second information processingdevice 1200S. Here, it is assumed that the analyzed result contains acontrol instruction to the controlled apparatus A that is a first-typeapparatus 1010.

After that, the second information processing device 1200S receives thedetermined result from the first information processing device 1100S(W6), and determines a control content over the first-type apparatus1010 (controlled apparatus A) (W7). The first control unit 1210 of thesecond information processing device 1200S transmits an outputinstruction to the operating device 1050 (infrared output device 1070)via the communication unit 1203 to output an infrared patterncorresponding to the control instruction.

Subsequently, the infrared output device 1070 receives the outputinstruction from the second information processing device 1200S, outputsan infrared pattern based on the output instruction (W8), and controlsthe controlled apparatus A that is the first-type apparatus 1010 (W9).

On the other hand, when the first information processing device 1100Sdetermines in step W5 that a control instruction to a first-typeapparatus 1010 is not contained (No in W5), the first informationprocessing device 1100S determines whether a control instruction to asecond-type apparatus 1020 is contained (W10). When the firstinformation processing device 1100S determines that a controlinstruction to a second-type apparatus 1020 is contained (Yes in W10),the first information processing device 1100S transmits the determinedresult to the second information processing device 1200S. Here, it isassumed that the analyzed result contains a control instruction to thecontrolled apparatus B that is a second-type apparatus 1020.

After that, the second information processing device 1200S receives thedetermined result from the first information processing device 1100S(W11), and determines a control content over the second-type apparatus1020 (controlled apparatus B) (W12). The second control unit 1220 of thesecond information processing device 1200S controls the controlledapparatus B that is the second-type apparatus 1020 via the network NWbased on the control instruction (W13).

On the other hand, when the first information processing device 1100Sdetermines in step W10 that a control instruction to a second-typeapparatus 1010 is not contained (No in W10), the first informationprocessing device 11005 determines whether a control instruction to athird-type apparatus 1030 is contained (W14). When the first informationprocessing device 11005 determines that a control instruction to athird-type apparatus 1030 is contained (Yes in W14), the firstinformation processing device 1100S transmits the determined result tothe third information processing device 1300S. Here, it is assumed thatthe analyzed result contains a control instruction to the controlledapparatus C that is a third-type apparatus 1030.

After that, the third information processing device 1300S receives thedetermined result from the first information processing device 1100S(W15), and determines a control content over the third-type apparatus1030 (controlled apparatus C) (W16). The third information processingdevice 1300S controls the controlled apparatus C that is the third-typeapparatus 1030 via the network NW based on the control instruction(W17).

When the first information processing device 1100S determines in stepW14 that a control instruction to a third-type apparatus 1030(controlled apparatus C) is not contained (No in W14), the operatingsystem 1001S ends the process.

The processes of step W5 to step W9, the processes of step W10 to stepW13, and the processes of step W14 to step W17 are not in particularorder and any one of sets of the processes may be executed first.

(1-2-3) Characteristics

(1-2-3-1)

As described above, with the operating system 1001S according to thepresent embodiment, in addition to the configuration of the operatingsystem 1001 according to the first embodiment, the first informationprocessing device 1100S communicates with the third informationprocessing device 1300S that is able to operate a third-type apparatus1030 different from a second-type apparatus 1020 via the network NW. Thecontrol instruction determination unit 1120S of the first informationprocessing device 1100S further determines whether a result analyzed bythe operation information analyzing unit 1110 contains a controlinstruction to a control instruction to a third-type apparatus 1030.When the control instruction determination unit 11205 determines that acontrol instruction to a third-type apparatus 1030 is contained, thefirst information processing device 1100S transmits an operation commandcorresponding to the control instruction to the third informationprocessing device 1300S.

Therefore, with the operating system 1001S according to the presentembodiment, when it is determined that operation information contains acontrol instruction to a first-type apparatus 1010 (controlled apparatusA) as a result of analysis of the operation information, the first-typeapparatus 1010 (controlled apparatus A) is controlled by transmission ofan infrared pattern to the first-type apparatus (controlled apparatusA). When the operating system 1001S determines that the operationinformation contains a control instruction to a second-type apparatus(controlled apparatus B) as a result of analysis of the operationinformation, the operating system 1001S controls the second-typeapparatus 1020 (controlled apparatus B) via the network NW. When theoperating system 1001S determines that the operation informationcontains a control instruction to a third-type apparatus 1030(controlled apparatus C) as a result of analysis of the operationinformation, the operating system 1001S transmits an operation commandto the third-type apparatus 1030 (controlled apparatus C) via thenetwork NW to the third information processing device 1300S that is ableto operate the third-type apparatus 1030 (controlled apparatus C).

Therefore, the operating system that is able to not only operate afirst-type apparatus 1010 (controlled apparatus A) and a second-typeapparatus 1020 (controlled apparatus B) but also transmit an operatinginstruction to a third-type apparatus 1030 (controlled apparatus C) notoperable by the second information processing device 1200S can beprovided. As a result, an operating system with further highextensibility can be provided.

(1-2-3-2)

In the operating system 1001S according to the present embodiment, thesecond information processing device 1200S and the second-typeapparatuses 1020 are connected via a first communication adaptor 1007Athat communicates under a first communication protocol. The thirdinformation processing device 1300S and the third-type apparatuses 1030are connected via a second communication adaptor 1007B that communicatesunder a second communication protocol different from the firstcommunication protocol. In this way, with the operating system 1001S,the operating system 1001S that is able to transmit an operation commandalso to a third-type apparatus 1030 that communicates under acommunication protocol different from that of the second-typeapparatuses 1020 can be provided.

(1-2-4) Modifications (1-2-4-1) Modification 2A

In the operating system 1001S according to the present embodiment, asshown in the sequences of FIG. 26A and FIG. 26B, the input receivingdevice 1060 may determine whether the third-type apparatus 1030 has beencontrolled by the third information processing device 1300S and transmita determined result to the first information processing device 1100Sand/or the second information processing device 1200S (step W18 to stepW20).

In this case, the input receiving device 1060 (operating device 1050)determines whether the third-type apparatus 1030 has been controlled andtransmits a determined result to the first information processing device1100S and/or the second information processing device 1200S. Therefore,for example, even when an administrator of the first informationprocessing device 1100S and/or an administrator of the secondinformation processing device 1200S is different from an administratorof the third information processing device 1300S, the administrator ofthe first information processing device 1100S and/or the administratorof the second information processing device 1200S is able to judgewhether the third-type apparatus 1030 has been controlled by the thirdinformation processing device 1300S. For example, the input receivingdevice 1060 determines whether the third-type apparatus 1030 has beencontrolled based on, for example, whether a surrounding apparatus hasbeen operated within a predetermined time from transmission of voiceinformation. Thus, the operating system 1001S can be furtherappropriately managed.

(1-2-4-2) Modification 2B

FIG. 27 is a schematic diagram that shows the configuration of theoperating system 1001S according to a modification 2B. FIG. 28 is aschematic diagram that shows the configuration of the second informationprocessing device 1200S according to the modification 2B.

In the modification 2B, the environmental information detectingapparatus K is present around the controlled apparatuses A, B, C. Theenvironmental information detecting apparatus K is a second-typeapparatus 1020 k, and detects environmental information that indicatesthe status of a surrounding environment. Environmental informationcontains information, such as temperature, humidity, and illuminance.

In the modification 2B, the storage unit 1204S of the second informationprocessing device 1200S functions as an associated apparatus storageunit 1240S, and the processing unit 1205S of the second informationprocessing device 1200S further functions as an environmentalinformation acquiring unit 1241S, an associated apparatus extractingunit 1242S, and an associated apparatus control unit 1243S.

The associated apparatus storage unit 1240S stores any one or anycombination of another first-type apparatus 1010 r (associated apparatusD), another second-type apparatus 1020 r (associated apparatus E), oranother third-type apparatus 1030 r (associated apparatus F) as anassociated apparatus in association with any one of a first-typeapparatus 1010 (controlled apparatus A), a second-type apparatus 1020(controlled apparatus B), and a third-type apparatus 1030 (controlledapparatus C) and environmental information. For example, as shown inFIG. 29, the associated apparatus storage unit 1240S stores an “S-modelluminaire” (associated apparatus D) that is a first-type apparatus 1010r and a “T-model luminaire” (associated apparatus E) that is athird-type apparatus 1030 r as associated apparatuses in associationwith “illuminance information” that is environmental information and an“S-model television” that is a first-type apparatus 1010 (controlledapparatus A). For example, the associated apparatus storage unit 1240Sstores a “T-model luminaire” (associated apparatus D) that is afirst-type apparatus 1010 r as an associated apparatus in associationwith “illuminance information” that is environmental information and a“T-model television” that is a third-type apparatus 1010 (controlledapparatus C). For example, the associated apparatus storage unit 1240Sstores a “D-model electric fan” (associated apparatus D) that is afirst-type apparatus 1010 r as an associated apparatus in associationwith “temperature information” that is environmental information and an“H-model air conditioner” that is a first-type apparatus 1010(controlled apparatus A). For example, the associated apparatus storageunit 1240S stores a “C-model far infrared heater” (associated apparatusD) that is a first-type apparatus 10 r and a “D-model far infraredheater” (associated apparatus E) that is a second-type apparatus 1020 ras associated apparatuses in association with “temperature information”that is environmental information and a “D-model air conditioner” thatis a second-type apparatus 1020 (controlled apparatus B). For example,the associated apparatus storage unit 1240S stores a “D-model electricfan” (associated apparatus D) that is a first-type apparatus 1010 r andan “M-model electric fan” (associated apparatus F) that is a third-typeapparatus 1030 r as associated apparatuses in association with“temperature information” that is environmental information and an“M-model air conditioner” that is a third-type apparatus 1030(controlled apparatus C).

The environmental information acquiring unit 1241S acquires“environmental information” at predetermined timing from theenvironmental information detecting apparatus K.

When the control instruction determination unit 1120S determines that acontrol instruction to any one of a first-type apparatus 1010(controlled apparatus A), a second-type apparatus 1020 (controlledapparatus B), and a third-type apparatus 1030 (controlled apparatus C)is contained, the associated apparatus extracting unit 1242S extractsassociated apparatuses from the associated apparatus storage unit 1240S.

When another first-type apparatus 1010 r (associated apparatus D) isextracted as an associated apparatus by the associated apparatusextracting unit 1242S, the associated apparatus control unit 1243 Stransmits an output instruction toward the extracted associatedapparatus (associated apparatus D) to the infrared output device 1070.When another second-type apparatus 1020 r (associated apparatus E) isextracted as an associated apparatus by the associated apparatusextracting unit 1242S, the associated apparatus control unit 12435controls the extracted associated apparatus (associated apparatus E) viathe network NW. When another third-type apparatus 1030 r (associatedapparatus F) is extracted by the associated apparatus extracting unit1242S as an associated apparatus, the associated apparatus control unit1243S transmits an operation command corresponding to a controlinstruction to the associated apparatus (associated apparatus F) to thethird information processing device 1300S.

FIG. 30A, FIG. 30B, FIG. 31A, and FIG. 31B are sequence diagrams thatshow the operation of the modification 2B. In the modification 2B, theabove-described operation of step W1 to step W17 is executed. Here, theprocess of “control over the associated apparatus(es)” of the followingstep X1 to step X13 is added between step W11 and step W12. It isassumed that, in the modification 2B, the environmental informationdetecting apparatus K is present around the controlled apparatuses A, B,C and environmental information is transmitted from the environmentalinformation detecting apparatus K to the second information processingdevice 1200S at predetermined timing (step W18 and step W19).

In the process of “control over the associated apparatus(es)”, when thecontrol instruction determination unit 1120S of the first informationprocessing device 1100S determines that a control instruction to afirst-type apparatus 1010 (controlled apparatus A), a controlinstruction to a second-type apparatus 1020 (controlled apparatus B), ora control instruction to a third-type apparatus 1030 (controlledapparatus C) is contained, the associated apparatus extracting unit12425 of the second information processing device 1200S extractsassociated apparatus(es) (associated apparatuses D, E, F) from theassociated apparatus storage unit 1240S (X1).

When another first-type apparatus 1010 r is extracted as an associatedapparatus (associated apparatus D) by the associated apparatusextracting unit 1242S (Yes in X2), the associated apparatus control unit12435 of the second information processing device 1200S transmits anoutput instruction toward the extracted associated apparatus (associatedapparatus D) to the infrared output device 1070 (X3). In response tothis, the infrared output device 1070 outputs an infrared pattern to thefirst-type apparatus 1010 r (associated apparatus D) and controls thefirst-type apparatus 1010 r (associated apparatus D) (X4, X5).

On the other hand, when another first-type apparatus 1010 r is notextracted as an associated apparatus (associated apparatus D) by theassociated apparatus extracting unit 12425 (No in X2), the processproceeds to the process of step X6. In step X6, when another second-typeapparatus 1020 r is extracted as an associated apparatus (associatedapparatus E) by the associated apparatus extracting unit 1242S (Yes inX6), the associated apparatus control unit 12435 of the secondinformation processing device 1200S controls the extracted associatedapparatus (associated apparatus E) via the network NW (X7, X8).

On the other hand, when another second-type apparatus 1020 r is notextracted as an associated apparatus (associated apparatus E) by theassociated apparatus extracting unit 12425 (No in X6), the processproceeds to the process of step X9. In step X9, when another third-typeapparatus 1030 r is extracted as an associated apparatus (associatedapparatus F) by the associated apparatus extracting unit 1242S (Yes inX9), the associated apparatus control unit 12435 of the secondinformation processing device 1200S controls the extracted associatedapparatus (associated apparatus F) via the network NW (X10). In responseto this, the third information processing device 1300S controls thethird-type apparatus 1030 r (associated apparatus F) via the network NW(X11 to X13).

When another third-type apparatus 1030 r is not extracted as anassociated apparatus (associated apparatus F) by the associatedapparatus extracting unit 1242S (No in X9), the process is ended.

The processes of step X2 to step X5, the processes of step X6 to stepX8, and the processes of step X9 to step X13 are not in particular orderand any one of sets of the processes may be executed first.

With the operating system 1001S according to the above-describedmodification 2B, when the second information processing device 1200S hasextracted a third-type apparatus 1030 r (associated apparatus F) as anassociated apparatus, the second information processing device 1200Stransmits an operation command to the third-type apparatus 1030 r(associated apparatus F) via the network based on the controlinstruction and the environmental information. Therefore, an apparatuscan be appropriately controlled according to the environment of the user1005.

(1-2-4-3) Other Modifications

The modifications 1A to 1J are also directly applicable to the presentembodiment.

Third Embodiment

In the operating system 1001 according to the first embodiment, thefirst information processing device 1100 includes the controlinstruction determination unit 1120. Alternatively, the secondinformation processing device may include this function.

(1-3-1) Configuration of Operating System 1001

In an operating system 1001T according to a third embodiment of thepresent invention, a second information processing device 1200T includesa control instruction determination unit 1207T as shown in FIG. 32. Inother words, in the second information processing device 1200T, theprocessing unit 1205 further functions as the “control instructiondetermination unit 1207T”. In the operating system 1001T according tothe third embodiment, an operation information analyzing unit 1110T of afirst information processing device 1100T transmits text informationconverted from voice information to the control instructiondetermination unit 1207T of the second information processing device1200T.

The control instruction determination unit 1207T determines whether aresult analyzed by the operation information analyzing unit 1110T of thefirst information processing device 1100T contains a control instructionto a first-type apparatus 1010 or a control instruction to a second-typeapparatus 1020.

Here, when the control instruction determination unit 1207T hasidentified that a controlled apparatus is a first-type apparatus 1010,the control instruction determination unit 1207T transmits a controlcontent over the controlled apparatus to the first control unit 1210T.On the other hand, when the control instruction determination unit 1207has identified that a controlled apparatus is a second-type apparatus1020, the control instruction determination unit 1207 transmits acontrol content over the controlled apparatus to the second control unit1220T.

When a result determined by the control instruction determination unit1207T contains a control instruction to a first-type apparatus 1010, thefirst control unit 1210T transmits an output instruction to theoperating device 1050 (infrared output device 1070) via thecommunication unit 1203 to output an infrared pattern corresponding tothe control instruction. When a result determined by the controlinstruction determination unit 1207T contains a control instruction to asecond-type apparatus 1020, the second control unit 1220T controls thesecond-type apparatus 1020 via the network NW based on the controlinstruction.

(1-3-2) Operation of Operating System 1T

FIG. 33 is a sequence diagram for illustrating the operation of theoperating system 1001T according to the present embodiment. With theabove-described configuration, processes as shown in FIG. 33 areexecuted in the operating system 1001T according to the thirdembodiment.

In the following description, for the sake of convenience, it is assumedthat a controlled apparatus A is present as a first-type apparatus 1010and a controlled apparatus B is present as a second-type apparatus 1020around the user 1005.

First, an input operation on an apparatus present around the user 1005is performed by the user 1005. Here, an operation command to thecontrolled apparatus A or the controlled apparatus B is input by theuser 1005 by voice (A1). For example, a command, such as “Turn on thepower of the controlled apparatus A” and “Turn off the controlledapparatus B”, is input by the user 1005 by voice.

Subsequently, the input receiving device 1060 receives the voice inputperformed by the user 1005, converts the input voice to voiceinformation, and transmits the voice information to the firstinformation processing device 1100T and the second informationprocessing device 1200T (A2).

In the second information processing device 1200T, the received voiceinformation is accumulated as needed (A3).

In the first information processing device 1100T, the operationinformation analyzing unit 1110T analyzes the voice information receivedfrom the operating device 1050 (A4). For example, the operationinformation analyzing unit 1110T of the first information processingdevice 1100T analyzes the voice information by using neural network, orthe like. Here, the operation information analyzing unit 1110T of thefirst information processing device 1100T analyzes a meaningcorresponding to the voice information and converts the voiceinformation to text information. The analyzed result of the voiceinformation is transmitted to the second information processing device1200T.

The control instruction determination unit 1207T of the secondinformation processing device 1200T determines whether a result analyzedby the operation information analyzing unit 1110T contains a controlinstruction to a first-type apparatus 1010 or a control instruction to asecond-type apparatus 1020 (A5). When the second information processingdevice 1200T determines that a control instruction to a first-typeapparatus 1010 is contained (Yes in A5), the second informationprocessing device 1200T transmits the determined result to the firstcontrol unit 1210T. Here, it is assumed that the analyzed resultcontains a control instruction to the controlled apparatus A that is afirst-type apparatus.

After that, the first control unit 1210T of the second informationprocessing device 1200T receives the determined result (A6), anddetermines a control content over the first-type apparatus 1010(controlled apparatus A) based on the determined result (A7). The firstcontrol unit 1210T of the second information processing device 1200Ttransmits an output instruction to the operating device 1050 (infraredoutput device 1070) via the communication unit 1203 to output aninfrared pattern corresponding to the control instruction.

Subsequently, the infrared output device 1070 receives the outputinstruction from the second information processing device 1200T, outputsan infrared pattern based on the output instruction (A8), and controlsthe controlled apparatus A that is the first-type apparatus 1010 (A9).

On the other hand, when the second information processing device 1200Tdetermines in step A5 that a control instruction to a first-typeapparatus 1010 is not contained (No in A5), the second informationprocessing device 1200T determines whether a control instruction to asecond-type apparatus 1020 is contained (A10). When the secondinformation processing device 1200T determines that a controlinstruction to a second-type apparatus 1020 is contained (Yes in A10),the second information processing device 1200T transmits the determinedresult to the second control unit 1220T. Here, it is assumed that theanalyzed result contains a control instruction to the controlledapparatus B that is a second-type apparatus 1020.

After that, the second control unit 1220T of the second informationprocessing device 1200T acquires the determined result (A11), anddetermines a control content over the second-type apparatus 1020(controlled apparatus B) (A12). The second control unit 1220T of thesecond information processing device 1200T controls the controlledapparatus B that is the second-type apparatus 1020 via the network NWbased on the control instruction (A13). When the second informationprocessing device 1200T determines in step A10 that a controlinstruction to a second-type apparatus 1020 (controlled apparatus B) isnot contained (No in A10), the operating system 1001 ends the process.

The processes of step A5 to step A9 and the processes of step A10 tostep A13 are not in particular order and any one of sets of theprocesses may be executed first.

(1-3-3) Characteristics

(1-3-3-1)

As described above, the operating system 1001T according to the presentembodiment includes the input receiving device 1060, the firstinformation processing device 1100T, the second information processingdevice 1200T, and the infrared output device 1070, and operates afirst-type apparatus 1010 operable by at least communication of aninfrared pattern and a second-type apparatus 1020 operable via at leastthe network NW. The input receiving device 1060 receives an inputoperation. The first information processing device 1100T is connected tothe input receiving device 1060 and includes the operation informationanalyzing unit 1110T that analyzes operation information correspondingto the input operation. The second information processing device 1200Tis connected to the first information processing device 1100T. When thecontrol instruction determination unit 1207T determines that a controlinstruction to a second-type apparatus 1020 (controlled apparatus B) iscontained, the second information processing device 1200T controls thesecond-type apparatus 1020 (controlled apparatus B) via the network NWbased on the control instruction. The infrared output device 1070 isconnected to the first information processing device 1100 or the secondinformation processing device 1200. When the control instructiondetermination unit 1207T determines that a control instruction to afirst-type apparatus 1010 (controlled apparatus A) is contained, theinfrared output device 1070 outputs an infrared pattern corresponding tothe control instruction to the first-type apparatus 1010 (controlledapparatus A).

In the operating system 1001T according to the present embodiment, thesecond information processing device 1200T includes the controlinstruction determination unit 1207T that determines whether a resultanalyzed by the operation information analyzing unit 1110T contains acontrol instruction to a first-type apparatus 1010 (controlled apparatusA) or a control instruction to a second-type apparatus 1020 (controlledapparatus B).

Therefore, with the operating system 1001T according to the presentembodiment, when it is determined that operation information contains acontrol instruction to a first-type apparatus as a result of analysis ofthe operation information, the first-type apparatus 1010 (controlledapparatus A) is controlled by transmission of an infrared pattern to thefirst-type apparatus 1010 (controlled apparatus A). On the other hand,when the operating system 1001T determines that the operationinformation contains a control instruction to a second-type apparatus1020 (controlled apparatus B) as a result of analysis of the operationinformation, the operating system 1001T controls the second-typeapparatus 1020 (controlled apparatus B) via the network NW. In otherwords, an apparatus not operable via the network NW (first-typeapparatus 1010) is operated by the infrared output device 1070, and anapparatus operable via the network NW (second-type apparatus 1020) isoperated by the second information processing device 1200T. Therefore,any apparatus around the operating device 1050 (input receiving device1060) can be controlled.

Particularly, with the operating system 1001T according to the presentembodiment, the operation information analyzing unit 1110T of the firstinformation processing device 1100T analyzes operation information inputby voice. Therefore, the operating system 1001 is able to control afirst-type apparatus 1010 and a second-type apparatus 1020 by voiceinput.

With the operating system 1001T according to the present embodiment,when a result determined by the control instruction determination unit1207 contains a control instruction to a first-type apparatus 1010(controlled apparatus A), the second information processing device 1200Ttransmits an output instruction to the infrared output device 1070 tooutput an infrared pattern corresponding to the control instruction tothe first-type apparatus 1010 (controlled apparatus A).

In this way, the second information processing device 1200 transmits anoutput instruction to the infrared output device 1070. Therefore, in thesecond information processing device 1200, it can be judged whether thefirst-type apparatus 1010 (controlled apparatus A) has been controlled.As a result, the reliability of the operating system 1001 is improved.

(1-3-3-2)

Other than the above, the operating system 1001T according to the thirdembodiment has similar characteristics to those of the operating system1001 according to the first embodiment. The modifications of the firstembodiment are also directly applicable to the operating system 1001Taccording to the third embodiment. Specifically, step S5 and step S10 inFIG. 7, FIG. 8, FIG. 11, FIG. 14, and FIG. 18 are replaced with theabove-described step A5 and step A10.

Fourth Embodiment

Similar components to those of the operating system 1001S according tothe second embodiment as well as the first embodiment may be added tothe operating system 1001T according to the control system according tothe third embodiment.

(1-4-1) Configuration of Operating System 1001V

In the operating system 1001T according to a fourth embodiment of thefirst invention, a second information processing device 1200V includes acontrol instruction determination unit 1207V as shown in FIG. 34. In thefourth embodiment, an operation information analyzing unit 1110V of afirst information processing device 1100V transmits text informationconverted from voice information to the control instructiondetermination unit 1207V of the second information processing device1200V.

In the fourth embodiment, the control instruction determination unit1207V of the second information processing device 1200V furtherdetermines whether a result analyzed by the operation informationanalyzing unit 1110V contains a control instruction to a controlinstruction to a third-type apparatus 1030. When the control instructiondetermination unit 1207V determines that a control instruction to athird-type apparatus 1030 is contained, the control instructiondetermination unit 1207V transmits an operation command corresponding tothe control instruction to a third information processing device 1300V.

(1-4-2) Operation of Operating System 1001V

FIG. 35A and FIG. 35B are sequence diagrams for illustrating theoperation of the operating system 1001V according to the presentembodiment. In the following description, for the sake of convenience,it is assumed that a controlled apparatus A is present as a first-typeapparatus 1010, a controlled apparatus B is present as a second-typeapparatus 1020, and a controlled apparatus C is present as a third-typeapparatus 1030 around the user 1005.

First, voice input on an apparatus present around the user 1005 isperformed by the user 1005 (B1). For example, a command, such as “Turnon the power of the controlled apparatus A” and “Turn off the controlledapparatus B”, is input by voice.

Subsequently, the input receiving device 1060 receives the voice inputperformed by the user 1005, converts the input voice to voiceinformation, and transmits the voice information to the firstinformation processing device 1100V and the second informationprocessing device 1200V (B2).

In the second information processing device 1200V, voice information isaccumulated as needed (B3).

In the first information processing device 1100V, the operationinformation analyzing unit 1110 analyzes the voice information receivedfrom the operating device 1050 (B4). For example, the operationinformation analyzing unit 1110V of the first information processingdevice 1100V analyzes the voice information by using neural network, orthe like. The operation information analyzing unit 1110V of the firstinformation processing device 1100V analyzes a meaning corresponding tothe voice information and converts the voice information to textinformation.

Subsequently, the control instruction determination unit 1207V of thesecond information processing device 1200V determines whether the resultanalyzed by the operation information analyzing unit 1110V contains acontrol instruction to a first-type apparatus 1010 (B5). When the secondinformation processing device 1200V determines that a controlinstruction to a first-type apparatus 1010 (controlled apparatus A) iscontained (Yes in B5), the second information processing device 1200Vtransmits the determined result to the first control unit 1210V. Here,it is assumed that the analyzed result contains a control instruction tothe controlled apparatus A that is a first-type apparatus 1010.

After that, the first control unit 1210V of the second informationprocessing device 1200V receives the determined result (B6), anddetermines a control content over the first-type apparatus 1010(controlled apparatus A) based on the determined result (B7). The firstcontrol unit 1210V of the second information processing device 1200Vtransmits an output instruction to the operating device 1050 (infraredoutput device 1070) via the communication unit 1203 to output aninfrared pattern corresponding to the control instruction.

Subsequently, the infrared output device 1070 receives the outputinstruction from the second information processing device 1200V, outputsan infrared pattern based on the output instruction (B8), and controlsthe controlled apparatus A that is the first-type apparatus 1010 (B9).

On the other hand, when the second information processing device 1200Vdetermines in step B5 that a control instruction to a first-typeapparatus 1010 is not contained (No in B5), the second informationprocessing device 1200V determines whether a control instruction to asecond-type apparatus 1020 is contained (B10). When the secondinformation processing device 1200V determines that a controlinstruction to a second-type apparatus 1020 is contained (Yes in B10),the second information processing device 1200V transmits the determinedresult to the second control unit 1220V. Here, it is assumed that theanalyzed result contains a control instruction to the controlledapparatus B that is a second-type apparatus 1020.

After that, the second control unit 1220V of the second informationprocessing device 1200V acquires the determined result (B11), anddetermines a control content over the second-type apparatus 1020(controlled apparatus B) (B12). The second control unit 1220V of thesecond information processing device 1200V controls the controlledapparatus B that is the second-type apparatus 1020 via the network NWbased on the control instruction (B13).

On the other hand, when the second information processing device 1200Vdetermines in step B10 that a control instruction to a second-typeapparatus 1010 is not contained (No in B10), the control instructiondetermination unit 1207V of the second information processing device1200V determines whether a control instruction to a third-type apparatus1030 is contained (B14). When the second information processing device1200V determines that a control instruction to a third-type apparatus1030 is contained (Yes in B14), the second information processing device1200V transmits the determined result to the third informationprocessing device 1300V. Here, it is assumed that the analyzed resultcontains a control instruction to the controlled apparatus C that is athird-type apparatus 1030.

After that, the third information processing device 1300V receives thedetermined result from the second information processing device 1200V(B15), and determines a control content over the third-type apparatus1030 (controlled apparatus C) (B16). The third information processingdevice 1300V controls the controlled apparatus C that is the third-typeapparatus 1030 via the network NW based on the control instruction(B17).

When it is determined in step B14 that a control instruction to athird-type apparatus 1030 (controlled apparatus C) is not contained (Noin B14), the operating system 1001V ends the process.

The processes of step B5 to step B9, the processes of step B10 to stepB13, and the processes of step B14 to step B17 are not in particularorder and any one of sets of the processes may be executed first.

(1-4-3) Characteristics

(1-4-3-1)

As described above, with the operating system 1001V according to thepresent embodiment, in addition to the configuration of the operatingsystem 1001T according to the third embodiment, the second informationprocessing device 1200V communicates with the third informationprocessing device 1300V that is able to operate a third-type apparatus1030 different from a second-type apparatus 1020 via the network NW. Thecontrol instruction determination unit 1207V of the second informationprocessing device 1200V further determines whether the result analyzedby the operation information analyzing unit 1110V contains a controlinstruction to a control instruction to a third-type apparatus 1030.When the control instruction determination unit 1207V determines that acontrol instruction to a third-type apparatus 1030 is contained, thesecond information processing device 1200V transmits an operationcommand corresponding to the control instruction to the thirdinformation processing device 1300V.

Therefore, with the operating system 1001V according to the presentembodiment, when it is determined that operation information contains acontrol instruction to a first-type apparatus 1010 (controlled apparatusA) as a result of analysis of the operation information, the first-typeapparatus 1010 (controlled apparatus A) is controlled by transmission ofan infrared pattern to the first-type apparatus 1010 (controlledapparatus A). When the operating system 1001V determines that theoperation information contains a control instruction to a second-typeapparatus (controlled apparatus B) as a result of analysis of theoperation information, the operating system 1001V controls thesecond-type apparatus 1020 (controlled apparatus B) via the network NW.When the operating system 1001V determines that the operationinformation contains a control instruction to a third-type apparatus1030 (controlled apparatus C) as a result of analysis of the operationinformation, the operating system 1001V transmits an operation commandto the third-type apparatus 1030 (controlled apparatus C) via thenetwork NW to the third information processing device 1300V that is ableto operate the third-type apparatus 1030 (controlled apparatus C).

Therefore, the operating system that is able to not only operate afirst-type apparatus 1010 (controlled apparatus A) and a second-typeapparatus 1020 (controlled apparatus B) but also transmit an operationcommand to a third-type apparatus 1030 (controlled apparatus C) notoperable by the second information processing device 1200V can beprovided. As a result, an operating system with further highextensibility can be provided.

(1-4-3-2)

Other than the above, the operating system 1001V according to the fourthembodiment has similar characteristics to those of the operating system1001S according to the second embodiment. The modifications of thesecond embodiment are also directly applicable to the operating system1001V according to the fourth embodiment. Specifically, step W5, stepW10, and step W14 in FIG. 25A, FIG. 25B, FIG. 26A, FIG. 26B, FIG. 30A,and FIG. 30B are replaced with the above-described step B5, step B10,and step B14.

Second Invention First Embodiment (2-1-1) Configuration of ControlSystem 2001

FIG. 36 and FIG. 37 are schematic diagrams that show the configurationof a control system 2001 according to a first embodiment of the secondinvention.

The control system 2001 includes an input receiving device 2060, aninfrared output device 2070, and an information processing device 2100.In the control system 2001, when a user 2005 inputs a control command tothe input receiving device 2060, a predetermined controlled apparatuscan be controlled. Here, “first-type apparatuses 2010” and “second-typeapparatuses 2020” are present as controlled apparatuses. It is assumedthat these controlled apparatuses are placed in a room R.

In FIG. 36 and FIG. 37, one of each of the input receiving device 2060,the infrared output device 2070, and the information processing device2100 is shown; however, the number of each device is not limitedthereto. The information processing device 2100 is connected to anynumber of the devices and is able to manage these devices.

The first-type apparatuses 2010 are controllable by using an infraredoutput signal. Examples of the first-type apparatuses 2010 include anelectric fan 2010 a, a luminaire 2010 b, a television 2010 c, and an airconditioner 2010 d. Supplementarily, a pattern of an infrared outputsignal is preset for each of the controlled apparatuses, and thecontrolled apparatuses 2010 can be controlled by using the associatedpatterns of an infrared output signal. Here, an associated relationshipbetween a pattern of an infrared output signal and a control content isstored in an infrared pattern DB 2104A (described later). In thefollowing description, reference numeral 2010 indicates any first-typeapparatus, and a lower-case alphabet is suffixed to indicate anindividual first-type apparatus.

The second-type apparatuses 2020 are directly controllable by theinformation processing device 2100 via the network NW. Examples of thesecond-type apparatuses 2020, as well as the first-type apparatuses2010, include an electric fan 2020 a, a luminaire 2020 b, a television2020 c, and an air conditioner 2020 d. In the following description,reference numeral 2020 indicates any second-type apparatus, and alower-case alphabet is suffixed to indicate an individual second-typeapparatus.

The input receiving device 2060 receives a control command to apredetermined controlled apparatus 2010 or a predetermined controlledapparatus 2020. Here, the input receiving device 2060 includes amicrophone and receives a control command to a controlled apparatus 2010or a controlled apparatus 2020 from the user 5 by voice input via themicrophone. The input receiving device 2060 transmits voice informationcorresponding to the received voice input to the information processingdevice 2100. When the input receiving device 2060 has detected voiceemitted by the user 2005, the input receiving device 2060 directlytransmits the voice information to the information processing device2100.

The infrared output device 2070 outputs infrared ray to a controlledapparatus (first-type apparatus) 2010. The infrared output device 2070includes an attitude control mechanism 2070A. When the infrared outputdevice 2070 has received relative position information (described later)from the information processing device 2100, the attitude controlmechanism 2070A controls the attitude of the infrared output device 2070based on the relative position information. The infrared output device2070 can be installed inside a fixed apparatus 2020F (described later).

As shown in FIG. 38, the information processing device 2100 includes aninput unit 2101, an output unit 2102, a communication unit 2103, astorage unit 2104, and a processing unit 2105, and is connected to theinput receiving device 2060 and the infrared output device 2070 via thenetwork NW, such as the Internet.

Here, the input unit 2101 is implemented by any input device and inputsvarious pieces of information to the information processing device 2100.The output unit 2102 is implemented by any output device and outputsvarious pieces of information from the information processing device2100. The communication unit 2103 is connected to the external networkNW and enables information communication.

The storage unit 2104 is implemented by a ROM, a RAM, or the like, andstores information that is input to the information processing device2100, information that is calculated by the information processingdevice 2100, and the like. The storage unit 2104 stores an “infraredpattern database (DB) 2104A” and a “relative position database (DB)2104B”.

The infrared pattern DB 2104A stores an associated relationship betweena pattern of an infrared output signal and a predetermined controlcommand for each controlled apparatus (first-type apparatus 2010).

The relative position DB 2104B stores “relative position information”that indicates a relative position between the infrared output device2070 and a controlled apparatus (first-type apparatus 2010) in apredetermined space (room R). When the infrared output device 2070 isfixed to the fixed apparatus 2020F, information that indicates arelative positional relationship between the position of the fixedapparatus 2020F and the position of a first-type apparatus 2010 may beused as relative position information instead of information thatindicates a relative positional relationship between the position of theinfrared output device 2070 and the position of a first-type apparatus2010.

The processing unit 2105 is implemented by a CPU, or the like, andexecutes information processing in the information processing device2100. Here, when the processing unit 2105 runs programs installed in thestorage unit 2104, the processing unit 2105 functions as a “voice inputanalyzing unit 2110”, a “control identifying unit 2120”, a “firstcontrol unit 2130”, and a “second control unit 2135”.

The voice input analyzing unit 2110 analyzes a content of input that isreceived from the input receiving device 2060. Specifically, the inputreceiving device 2060 analyzes a meaning corresponding to the voice byusing neural network, or the like, and converts voice information totext information.

The control identifying unit 2120 identifies a control content thatindicates a controlled apparatus and a control command from a resultanalyzed by the voice input analyzing unit 2110. For example, when theinput receiving device 2060 has received voice input, the controlidentifying unit 2120 identifies a control content by determiningwhether the text information converted by the voice input analyzing unit2110 contains language information associated with a controlledapparatus and a control command.

Here, when the control identifying unit 2120 has identified that thecontrolled apparatus is a first-type apparatus 2010, the controlidentifying unit 2120 transmits a control content associated with thecontrolled apparatus to the first control unit 2130. On the other hand,when the control identifying unit 2120 has identified that thecontrolled apparatus is a second-type apparatus 2020, the controlidentifying unit 2120 transmits a control content associated with thecontrolled apparatus to the second control unit 2135.

When the control content over a first-type apparatus 2010 has beenidentified by the control identifying unit 2120, the first control unit2130 transmits an infrared pattern corresponding to the control contentto the infrared output device 2070. More specifically, the first controlunit 2130 transmits an infrared output instruction to the infraredoutput device 2070 based on the control content identified by thecontrol identifying unit 2120 and the information stored in the infraredpattern DB 2104A. Thus, the first-type apparatus 2010 is controlled viathe infrared output device 2070. The first control unit 2130 transmitsrelative position information between the infrared output device 2070and the intended first-type apparatus 2010 to the infrared output device2070 together with the infrared output instruction. The relativeposition information is extracted from the relative position DB 2104B.

When the control content over a second-type apparatus 2020 has beenidentified by the control identifying unit 2120, the second control unit2135 controls the second-type apparatus 2020 via the network NW based onthe control content.

(2-1-2) Operation of Control System 2001

FIG. 39A and FIG. 39B are sequence diagrams for illustrating theoperation of the control system 2001 according to the presentembodiment.

First, the input receiving device 2060 is used by the user 2005, andvoice input on a controlled apparatus 2010 or a controlled apparatus2020 is performed (D1). The input receiving device 2060 transmits inputinformation corresponding to the received voice input to the informationprocessing device 2100 (D2).

Subsequently, the information processing device 2100 receives the inputinformation (D3) and analyzes the content of the voice input (D4). Afterthat, the information processing device 2100 identifies a controlcontent that indicates a controlled apparatus 2010 or a controlledapparatus 2020 and a control command to the controlled apparatus 2010 orthe controlled apparatus 2020 (D5).

Here, when the information processing device 2100 has identified thatthe control content is related to a first-type apparatus 2010 (Yes inD6), the information processing device 2100 extracts infrared patterninformation from the infrared pattern DB 2104A based on the controlcontent (D7). In addition, the information processing device 2100extracts relative position information between the first-type apparatus2010 and the infrared output device 2070 (or the fixed apparatus 2020F)from the relative position DB 2104B (D8). The information processingdevice 2100 transmits the infrared pattern information and the relativeposition information to the infrared output device 2070 together with aninfrared output instruction (D9).

Subsequently, as the infrared output device 2070 receives the infraredpattern information and the relative position information together withthe infrared output instruction (D10), the infrared output device 2070changes the attitude toward the intended controlled apparatus 2010 basedon the relative position information (D11). The infrared output device2070 outputs infrared ray toward the controlled apparatus (first-typeapparatus) 2010 based on the received infrared pattern information(D12).

On the other hand, in parallel with step D6, when the informationprocessing device 2100 has identified that the control content isrelated to a second-type apparatus 2020 (Yes in D13), the informationprocessing device 2100 controls the controlled apparatus (second-typeapparatus) 2020 via the network NW based on the control content (D14).

When the information processing device 2100 cannot identify in step D6or step D13 that the control content is related to a first-typeapparatus 2010 or a second-type apparatus 2020, the informationprocessing device 2100 ends the process (No in D6 or No in D13).

The processes of step D6 to step D9 and the processes of step D13 andstep D14 are not in particular order and any one of sets of theprocesses may be executed first.

(2-1-3) Characteristics

As described above, the control system 2001 according to the presentembodiment includes the input receiving device 2060, the infrared outputdevice 2070, and the information processing device 2100. Here, the inputreceiving device 2060 receives a control command to a controlledapparatus 2010 or a controlled apparatus 2020 from the user 2005 byvoice input. The infrared output device 2070 outputs infrared ray to thecontrolled apparatus 2010 or the controlled apparatus 2020. Theinformation processing device 2100 includes the voice input analyzingunit 2110, the control identifying unit 2120, the first control unit2130, and the second control unit 2135. The voice input analyzing unit2110 analyzes a content of input that is received from the inputreceiving device 2060. The control identifying unit 2120 identifies acontrol content that indicates a controlled apparatus and a controlcommand from a result analyzed by the voice input analyzing unit 2110.When the control content over a first-type apparatus 2010 has beenidentified by the control identifying unit 2120, the first control unit2130 transmits an infrared pattern corresponding to the control contentto the infrared output device 2070. When the control content over asecond-type apparatus 2020 has been identified by the controlidentifying unit 2120, the second control unit 2135 controls thesecond-type apparatus 2020 via the network NW based on the controlcontent.

Therefore, with the control system 2001 according to the presentembodiment, a first-type apparatus 2010 controllable by output of aninfrared pattern and a second-type apparatus 2020 controllable via thenetwork NW can be controlled.

In addition, with the control system 2001 according to the presentembodiment, the information processing device 2100 on the network NW isable to transmit an infrared output instruction to the infrared outputdevice 2070S based on a result of analysis of voice input. When anapparatus is intended to be controlled by voice input, the amount ofinformation processing can be enormous. Even in such a case, with thecontrol system 2001S, voice analysis can be highly accurately performedby using the information processing device 2100 that implements neuralnetwork, or the like, and that is constructed on the network NW. Thus,even with voice input, a controlled apparatus 2010 or a controlledapparatus 2020 and a control command can be minutely identified. As aresult, the control system 2001 that can easily control any apparatuscan be provided.

In the control system 2001 according to the present embodiment, theinformation processing device 2100 on the network NW includes theinfrared pattern DB 2104A, and stores an associated relationship betweena pattern of an infrared output signal and a predetermined controlcontent for each controlled apparatus. Thus, change, update, addition,and the like, of the pattern of an infrared output signal can becollectively set. However, in the control system 2001 according to thepresent embodiment, information in the infrared pattern DB 2104A may bestored not by the information processing device 2100 but by the storageunit of each infrared output device 2070.

(2-1-4) Use of Fixed Apparatus 2020F

As shown in FIG. 37, the infrared output device 2070 can be installedinside the fixed apparatus 2020F whose position is fixed in apredetermined space (room R). The fixed apparatus 2020F is, for example,an air-conditioning device, a luminaire, a television, or the like, andis fixed to a ceiling or wall of the room R. Alternatively, the fixedapparatus 2020F may be fixedly embedded in a ceiling or wall of the roomR. The fixed apparatus 2020F may be a second-type apparatus 2020.

Examples of the fixed apparatus 2020F include an air-conditioningdevice, a luminaire, and a television. For example, when anair-conditioning device 2020 d is used as the fixed apparatus 2020F, theinfrared output device 2070 is mounted in a control mechanism at theright back side of a front panel as shown in FIG. 40.

In this way, in the control system 2001 according to the presentembodiment, the infrared output device 2070 is installed inside thefixed apparatus 2020F whose position is fixed in the predetermined space(for example, room R). Since the position of the fixed apparatus 2020Fis fixed in the predetermined space (room R), the range of infrared raythat is output by the infrared output device 2070 installed in the fixedapparatus 2020F can be estimated in advance. Therefore, as long asapparatuses present in the range are controllable by infrared ray, theinfrared output device 2070 is able to easily control any controlledapparatus (first-type apparatus 2010). In addition, the infrared outputdevice 2070 is installed in the fixed apparatus 2020F. Therefore, noinstallation space for the infrared output device 2070 is required.

In the control system 2001 according to the present embodiment, thefixed apparatus 2020F is fixedly installed on a ceiling or wall of theroom R (see FIG. 37). Examples of the fixed apparatus fixedly installedon a ceiling or wall of the room R include a luminaire and anair-conditioning device. Any of these is installed at a higher positionin the predetermined space (room R). For this reason, the probability ofavoiding a shield placed in a transmission path of infrared ray in apredetermined space can be increased. In other words, the probabilitythat infrared ray reaches a controlled apparatus (first-type apparatus2010) can be increased. As a result, the reliability of the controlsystem 2001 is improved.

In the control system 2001 according to the present embodiment, theinformation processing device 2100S on the network NW includes therelative position DB 2104B and stores relative position information thatindicates a relative positional relationship between the position of theinfrared output device 2070 (or the fixed apparatus 2020F) and theposition of a controlled apparatus 2010 in the predetermined space.Thus, attitude control over each infrared output device 2070 is possibleat the information processing device 2100 side. However, in the controlsystem 2001, information in the relative position DB 2104B may be storednot by the information processing device 2100 but by the storage unit ofeach infrared output device 2070.

(2-1-4-1) Modification 3A

As shown in FIG. 41 as a concept, in the control system 2001 accordingto the present embodiment, the fixed apparatus 2020F may be fixedlyembedded in a ceiling or wall of the room R. Examples of the fixedapparatus fixedly embedded in a ceiling or wall of the room R include aluminaire, an air-conditioning device, and a wall-hanging television.Any of the fixed apparatuses is installed at a higher position in thepredetermined space (room R). For this reason, the probability ofavoiding a shield placed in a transmission path of infrared ray in apredetermined space can be increased.

(2-1-4-2) Modification 3B

As shown in FIG. 42 as a concept, in the control system 2001 accordingto the present embodiment, the input receiving device 2060 may bedisposed inside the fixed apparatus 2020F. Thus, the systemconfiguration is simplified. In addition, no new installation space forthe input receiving device 2060 is required.

(2-1-4-3) Modification 3C

The infrared output device 2070 according to the present embodiment maybe installed in an upper half region of the body of the fixed apparatus2020F. With such a configuration, infrared ray can be output from ahigher position. Thus, the probability of avoiding a shield placed in atransmission path of infrared ray in a predetermined space can beincreased. For example, the infrared output device is mounted at anupper part of a floor-standing air-conditioning device.

Second Embodiment (2-2-1) Configuration of Control System 2001S

FIG. 43 is a schematic diagram that shows the configuration of a controlsystem 2001S according to a second embodiment of the second invention.In the following description, like reference numerals denote the alreadydescribed components, and the description will not be repeated. In thepresent embodiment, components different from those of the otherembodiments can be described with a suffix “S”.

In the control system 2001S according to the present embodiment,different from the first embodiment, the input receiving device 2060Sand the infrared output device 2070S directly communicate with eachother, and the configuration of the information processing device 2100is omitted. In other words, the control system 2001S includes the inputreceiving device 2060S and the infrared output device 2070S and controlsa predetermined controlled apparatus (first-type apparatus) 2010. It isassumed that these apparatuses are placed in a room R. For the sake ofconvenience of description, FIG. 43 shows one controlled apparatus 2010;however, a plurality of controlled apparatuses 2010 may be present.

The input receiving device 2060S receives a control command to thecontrolled apparatus 2010. The input receiving device 2060S transmitsvoice information corresponding to the received voice input to theinfrared output device 2070S.

As shown in FIG. 44, the infrared output device 2070S includes an inputunit 2071, an output unit 2072, a communication unit 2073, a storageunit 2074, and a processing unit 2075. The infrared output device 2070Soutputs infrared ray to the controlled apparatus 2010 via the outputunit 2072. The infrared output device 2070S is installed in the fixedapparatus 2020F whose position is fixed in the predetermined space (roomR).

More specifically, the input unit 2071 inputs various pieces ofinformation to the infrared output device 2070S. The output unit 2072outputs various pieces of information from the infrared output device2070S. Here, infrared ray is output by the function of an infraredtransmitter that serves as the output unit 2072. The communication unit2073 is able to directly or indirectly connect with the external networkNW, or the like. Here, with the function of the communication unit 2073,the infrared output device 2070S and the input receiving device 2060Sare connected.

The storage unit 2074 is implemented by a ROM, a RAM, or the like, andstores information that is input to the infrared output device 2070,information that is calculated by the infrared output device 2070S, andthe like. For example, an “infrared pattern DB 2074A” is stored in thestorage unit 2074. The infrared pattern DB 2074A stores an associatedrelationship between a pattern of an infrared output signal and apredetermined control content for each controlled apparatus.

The processing unit 2075 is implemented by a CPU, or the like, andexecutes information processing in the infrared output device 2070S.Here, when the processing unit 2075 runs programs installed in thestorage unit 2074, the processing unit 2075 functions as an “outputinstruction transmission unit 2075A”. When the output instructiontransmission unit 2075A has received a control command from the inputreceiving device 2060, the output instruction transmission unit 2075Aoutputs infrared ray to the controlled apparatus 2010 based on theinformation stored in the infrared pattern DB 2074A.

(2-2-2) Characteristics

As described above, the control system 2001S according to the presentembodiment includes the input receiving device 2060S and the infraredoutput device 2070S. The input receiving device 2060S receives a controlcommand to a controlled apparatus 2010 controllable by infrared ray. Theinfrared output device 2070S is installed in the fixed apparatus 2020Fwhose position is fixed in the predetermined space (room R). When theinput receiving device 2060S has received a control command, theinfrared output device 2070S outputs infrared ray to the controlledapparatus 2010.

Therefore, with the control system 2001S according to the presentembodiment, the controlled apparatus 2010 can be controlled via infraredray by voice input. Since the position of the fixed apparatus 2020F isfixed in the predetermined space (room R), the range of infrared raythat is output by the infrared output device 2070S installed in thefixed apparatus 2020F can be estimated in advance. Therefore, as long asapparatuses present in the range are controllable by infrared ray, theinfrared output device 2070S is able to easily control any controlledapparatus 2010. In addition, the infrared output device 2070S isinstalled in the fixed apparatus 2020F. Therefore, no installation spacefor the infrared output device 2070S is required.

In the control system 2001 according to the present embodiment, thefixed apparatus 2020F is fixedly installed on a ceiling or wall of theroom R (see FIG. 36). Examples of the fixed apparatus fixedly mounted ona ceiling or wall of the room R include a luminaire and anair-conditioning device. Any of these is installed at a higher positionin the predetermined space (room R). For this reason, the probability ofavoiding a shield placed in a transmission path of infrared ray in apredetermined space can be increased. In other words, the probabilitythat infrared ray reaches a controlled apparatus 2010 can be increased.As a result, the reliability of the control system 2001 is improved.

(2-2-3) Modifications

As shown in FIG. 45, in the control system 2001S according to thepresent embodiment, the attitude control mechanism 2070S may beincorporated in the infrared output device 2070S. Here, as shown in FIG.46, the storage unit 2074 of the infrared output device 2070S includesthe “relative position DB 2074B”. The relative position DB 2074B stores“relative position information” that indicates a relative positionalrelationship between the infrared output device 2070S and a controlledapparatus 2010 in the predetermined space (room R). When the infraredoutput device 2070S outputs infrared ray, the processing unit 2075functions as the attitude control unit 2075B. The attitude control unit2075B extracts relative position information from the relative positionDB 2074B and changes the position of the infrared output device 2070 byactuating the attitude control mechanism 2070A based on the relativeposition information. Thus, the direction of output of infrared ray ofthe infrared output device 2070S is changed to a predetermineddirection. As a result, the probability that infrared ray reaches acontrolled apparatus 2010 can be increased, so the reliability of thecontrol system is improved.

Since the infrared output device 2070S is fixed to the fixed apparatus2020F, information that indicates a relative positional relationshipbetween the position of the fixed apparatus 2020F and the position of acontrolled apparatus 2010 as relative position information instead ofinformation that indicates a relative positional relationship betweenthe position of the infrared output device 2070S and the position of acontrolled apparatus 2010.

Other than the above, the modifications 3A to 3C of the first embodimentare also directly applicable to the present embodiment.

Third Invention (3-1) Configuration of Control System 3001

FIG. 47 and FIG. 48 are schematic diagrams that show the configurationof a control system 3001 according to an embodiment of the thirdinvention.

The control system 3001 includes an input receiving device 3060, aninfrared output device 3070, and an information processing device 3100.In the control system 3001, when a user 3005 inputs a control command tothe input receiving device 3060, a predetermined controlled apparatuscan be controlled. Here, “first-type apparatuses 3010” and “second-typeapparatuses 3020” are present as controlled apparatuses. It is assumedthat these controlled apparatuses are placed in a room R.

In FIG. 47 and FIG. 48, one of each of the input receiving device 3060,the infrared output device 3070, and the information processing device3100 is shown; however, the number of each device is not limitedthereto. The information processing device 3100 is connected to anynumber of the devices and is able to manage these devices.

The first-type apparatuses 3010 are controllable by using an infraredoutput signal. Examples of the first-type apparatuses 3010 include anelectric fan 3010 a, a luminaire 3010 b, a television 3010 c, and an airconditioner 3010 d. Supplementarily, a pattern of an infrared outputsignal is preset for each of the controlled apparatuses, and thecontrolled apparatuses 3010 can be controlled by using the associatedpatterns of an output signal of infrared. Here, an associatedrelationship between a pattern of an infrared output signal and acontrol content is stored in an infrared pattern DB 3104A (describedlater). In the following description, reference numeral 3010 indicatesany first-type apparatus, and a lower-case alphabet is suffixed toindicate an individual first-type apparatus.

The second-type apparatuses 3020 are directly controllable by theinformation processing device 3100 via the network NW. Examples of thesecond-type apparatuses 3020, as well as the first-type apparatuses3010, include an electric fan 3020 a, a luminaire 3020 b, a television3020 c, and an air conditioner 3020 d. In the following description,reference numeral 3020 indicates any second-type apparatus, and alower-case alphabet is suffixed to indicate an individual second-typeapparatus.

The input receiving device 3060 receives a control command on apredetermined controlled apparatus 3010 or a predetermined controlledapparatus 3020. Here, the input receiving device 3060 includes amicrophone and receives a control command on the controlled apparatus3010 or the controlled apparatus 3020 from the user 3005 by voice inputvia the microphone. The input receiving device 3060 transmits voiceinformation corresponding to the received voice input to the informationprocessing device 3100. When the input receiving device 3060 hasdetected voice emitted by the user 3005, the input receiving device 3060directly transmits the voice information to the information processingdevice 3100. However, the input receiving device 3060 is not limited toan input receiving device and receives input from any input device ormethod.

The infrared output device 3070 outputs infrared ray to a controlledapparatus (first-type apparatus) 3010. The infrared output device 3070includes an attitude control mechanism 3070A. When the infrared outputdevice 3070 has received relative position information (described later)from the information processing device 3100, the attitude controlmechanism 3070A controls the attitude of the infrared output device 3070based on the relative position information. The infrared output device3070 can be installed inside the fixed apparatus 3020F whose position isfixed in a predetermined space (room R). The fixed apparatus 3020F is,for example, an air-conditioning device, a luminaire, a television, orthe like, and is fixed to a ceiling or wall of the room R.Alternatively, the fixed apparatus 3020F may be fixedly embedded in aceiling or wall of the room R.

As shown in FIG. 49, the information processing device 3100 includes aninput unit 3101, an output unit 3102, a communication unit 3103, astorage unit 3104, and a processing unit 3105, and is connected to theinput receiving device 3060 and the infrared output device 3070 via thenetwork NW, such as the Internet.

Here, the input unit 3101 is implemented by any input device and inputsvarious pieces of information to the information processing device 3100.The output unit 3102 is implemented by any output device and outputsvarious pieces of information from the information processing device3100. The communication unit 3103 is connected to the external networkNW and enables information communication.

The storage unit 3104 is implemented by a ROM, a RAM, or the like, andstores information that is input to the information processing device3100, information that is calculated by the information processingdevice 3100, and the like. The storage unit 3104 stores an “infraredpattern database (DB) 3104A” and a “relative position database (DB)3104B”.

The infrared pattern DB 3104A stores an associated relationship betweena pattern of an infrared output signal and a predetermined controlcontent for each controlled apparatus (first-type apparatus 3010).

The relative position DB 3104B stores “relative position information”that indicates a relative positional relationship between the infraredoutput device 3070 and a controlled apparatus (first-type apparatus3010) in a predetermined space (room R). When the infrared output device3070 is fixed to the fixed apparatus 3020F, information that indicates arelative positional relationship between the position of the fixedapparatus 3020F and the position of a first-type apparatus 3010 may beused as relative position information instead of information thatindicates a relative positional relationship between the position of theinfrared output device 3070 and the position of a first-type apparatus3010.

The processing unit 3105 is implemented by a CPU, or the like, andexecutes information processing in the information processing device3100. Here, when the processing unit 3105 runs programs installed in thestorage unit 3104, the processing unit 3105 functions as an “inputanalyzing unit 3110”, a “control identifying unit 3120”, a “firstcontrol unit 3130”, and a “second control unit 3135”.

The input analyzing unit 3110 analyzes a content of input that isreceived from the input receiving device 3060. For example, when theinput receiving device 3060 has received voice input, the inputanalyzing unit 3110 analyzes the content of the voice input byconverting the content of the voice input to text information. When theinput analyzing unit 3110 analyzes the content of the voice input, theinput analyzing unit 3110 is able to highly accurately analyze thecontent by using neural network, or the like.

The control identifying unit 3120 identifies a control content thatindicates a controlled apparatus and a control command from a resultanalyzed by the input analyzing unit 3110. For example, when the inputreceiving device 3060 has received voice input, the control identifyingunit 3120 identifies a control content by determining whether textinformation converted by the input analyzing unit 3110 contains languageinformation associated with a controlled apparatus and a controlcommand.

Here, when the control identifying unit 3120 has identified that thecontrolled apparatus is a first-type apparatus 3010, the controlidentifying unit 3120 transmits a control content associated with thecontrolled apparatus to the first control unit 3130. On the other hand,when the control identifying unit 3120 has identified that thecontrolled apparatus is a second-type apparatus 3020, the controlidentifying unit 3120 transmits a control content associated with thecontrolled apparatus to the second control unit 3135.

When the control content over a first-type apparatus 3010 has beenidentified by the control identifying unit 3120, the first control unit3130 transmits an infrared pattern corresponding to the control contentto the infrared output device 3070. More specifically, the first controlunit 3130 transmits an infrared output instruction to the infraredoutput device 3070 based on the control content identified by thecontrol identifying unit 3120 and the information stored in the infraredpattern DB 3104A. Thus, the first-type apparatus 3010 is controlled viathe infrared output device 3070. The first control unit 3130 transmitsrelative position information between the infrared output device 3070and the intended first-type apparatus 3010 to the infrared output device3070 together with the infrared output instruction. The relativeposition information is extracted from the relative position DB 3104B.

When the control content over a second-type apparatus 3020 has beenidentified by the control identifying unit 3120, the second control unit3135 controls the second-type apparatus 3020 via the network NW based onthe control content.

(3-2) Operation of Control System 3001

FIG. 50A and FIG. 50B are sequence diagrams for illustrating theoperation of the control system 3001 according to the presentembodiment.

First, the input receiving device 3060 is used by the user 3005, andvoice input on a controlled apparatus 3010 or a controlled apparatus3020 is performed (E1). The input receiving device 3060 transmits inputinformation corresponding to the received voice input to the informationprocessing device 3100 (E2). Here, the input receiving device 3060receives an input operation by voice (voice input).

Subsequently, the information processing device 3100 receives the inputinformation (E3) and analyzes the content of the input (E4). After that,the information processing device 3100 identifies a control content thatindicates a controlled apparatus 3010 or a controlled apparatus 3020 anda control command to the controlled apparatus 3010 or the controlledapparatus 3020 (E5).

Here, when the information processing device 3100 has identified thatthe control content is related to a first-type apparatus 3010 (Yes inE6), the information processing device 3100 extracts infrared patterninformation from the infrared pattern DB 3104A based on the controlcontent (E7). In addition, the information processing device 3100extracts relative position information between the first-type apparatus3010 and the infrared output device 3070 (or the fixed apparatus 3020F)from the relative position DB 3104B (E8). The information processingdevice 3100 transmits the infrared pattern information and the relativeposition information to the infrared output device 3070 together with aninfrared output instruction (E9).

Subsequently, as the infrared output device 3070 receives the infraredpattern information and the relative position information together withthe infrared output instruction (E10), the infrared output device 3070changes the attitude toward the intended controlled apparatus 3010 basedon the relative position information (E11). The infrared output device3070 outputs infrared ray toward the controlled apparatus (first-typeapparatus) 3010 based on the received infrared pattern information(E12).

On the other hand, in parallel with step E6, when the informationprocessing device 3100 has identified that the control content isrelated to a second-type apparatus 3020 (Yes in E13), the informationprocessing device 3100 controls the controlled apparatus (second-typeapparatus) 3020 via the network NW based on the control content (E14).

When the information processing device 3100 cannot identify in step E6or step E13 that the control content is related to a first-typeapparatus 3010 or a second-type apparatus 3020, the informationprocessing device 3100 ends the process (No in E6 or No in E13).

The processes of step E6 to step E9 and the processes of step E13 andstep E14 are not in particular order and any one of sets of theprocesses may be executed first.

(3-3) Characteristics

As described above, the control system 3001 according to the presentembodiment includes the input receiving device 3060, the infrared outputdevice 3070, and the information processing device 3100. Here, the inputreceiving device 3060 receives a control command to a controlledapparatus 3010 or a controlled apparatus 3020 from the user 3005 byvoice input. The infrared output device 3070 outputs infrared ray to thecontrolled apparatus 3010 or the controlled apparatus 3020. Theinformation processing device 3100 includes the input analyzing unit3110, the control identifying unit 3120, the first control unit 3130,and the second control unit 3135. The input analyzing unit 3110 analyzesa content of input that is received from the input receiving device3060. The control identifying unit 3120 identifies a control contentthat indicates a controlled apparatus and a control command from aresult analyzed by the input analyzing unit 3110. When the controlcontent over a first-type apparatus 3010 has been identified by thecontrol identifying unit 3120, the first control unit 3130 transmits aninfrared pattern corresponding to the control content to the infraredoutput device 3070. When the control content over a second-typeapparatus 3020 has been identified by the control identifying unit 3120,the second control unit 3135 controls the second-type apparatus 3020 viathe network NW based on the control content.

Therefore, with the control system 3001 according to the presentembodiment, a first-type apparatus 3010 controllable by output of aninfrared pattern and a second-type apparatus 3020 controllable via thenetwork NW can be controlled.

In addition, with the control system 3001S according to the presentembodiment, the information processing device 3100 on the network NW isable to transmit an infrared output instruction to the infrared outputdevice 3070S based on a result of analysis of voice input. When anapparatus is intended to be controlled by voice input, the amount ofinformation processing can be enormous. Even in such a case, with thecontrol system 3001S, voice analysis can be highly accurately performedby using the information processing device 3100 that implements neuralnetwork, or the like, and that is constructed on the network NW. Thus,even with voice input, a controlled apparatus 3010 or a controlledapparatus 3020 and a control command can be minutely identified. As aresult, the control system 3001 that can easily control any apparatuscan be provided.

In the control system 3001 according to the present embodiment, theinformation processing device 3100 on the network NW includes theinfrared pattern DB 3104A, and stores an associated relationship betweena pattern of an infrared output signal and a predetermined controlcontent for each controlled apparatus. Thus, change, update, addition,and the like, of the pattern of an infrared output signal can becollectively set. However, in the control system 3001 according to thepresent embodiment, information in the infrared pattern DB 3104A may bestored not by the information processing device 3100 but by the storageunit of each infrared output device 3070.

(3-4) Use of Environmental Information Detecting Apparatus 3020K (3-4-1)Configuration of Control System 3001

As shown in FIG. 51, a configuration that the control system 3001according to the present embodiment further includes an environmentalinformation detecting apparatus 3020K may be employed.

The environmental information detecting apparatus 3020K detectsenvironmental information around a controlled apparatus 3010 or acontrolled apparatus 3020.

Environmental information contains information, such as temperature,humidity, and illuminance. Examples of the environmental informationdetecting apparatus 3020K include those using a voice sensor, anilluminance sensor, an air volume sensor, an image sensor (camera), aninfrared sensor, a temperature sensor, a pressure sensor, a humiditysensor, a thermistor, or the like. These pieces of environmentalinformation are transmitted to the information processing device 3100.The environmental information detecting apparatus 3020K may be asecond-type apparatus 3020.

As shown in FIG. 52, in the information processing device 3100, theprocessing unit 3105 further functions as a “control determination unit3140” and an “abnormality processing unit 3150”.

The control determination unit 3140 receives environmental informationfrom the environmental information detecting apparatus 3020K anddetermines whether the controlled apparatus (first-type apparatus) 3010has been controlled in accordance with an infrared output instructionand environmental information. For example, when the controlledapparatus 3010 is an air conditioner, the temperature of a surroundingenvironment changes. The control determination unit 3140 acquirestemperature information as environmental information and determineswhether the controlled apparatus 3010 has been controlled by determiningwhether there occurs a predetermined temperature change. For example,when the controlled apparatus 3010 is a television, the illuminance of asurrounding environment changes. The control determination unit 3140acquires illuminance information as environmental information anddetermines whether the controlled apparatus 3010 has been controlled bydetermining whether there occurs a predetermined illuminance change.

When the control determination unit 3140 determines (abnormalitydetermination) that the controlled apparatus 3010 has not beencontrolled based on an infrared output instruction and environmentalinformation, the abnormality processing unit 3150 executes abnormalityprocessing. For example, the abnormality processing unit 3150 executes aprocess of retransmitting an infrared output instruction to the infraredoutput device 3070 as abnormality processing.

(3-4-2) Operation of Control System 3001

FIG. 53A and FIG. 53B are sequence diagrams for illustrating theoperation of the control system 3001 according to the presentembodiment. In the following description, the description will be madeon the assumption that the controlled apparatus is a first-typeapparatus 3010.

The configuration that the control system 3001 according to the presentembodiment includes the environmental information detecting apparatus3020K is employed, so the following processes of step F1 to step F4 canbe added to the above-described step E1 to step E12.

In other words, the environmental information detecting apparatus 3020Kwhere necessary transmits environmental information around thecontrolled apparatus 3010 to the information processing device 3100(F1).

In response to this, in the information processing device 3100, it isdetermined whether the controlled apparatus 3010 is being controlled inaccordance with the output instruction based on the time of the outputinstruction transmitted to the infrared output device 3070, the time ofthe environmental information received from the environmentalinformation detecting apparatus 3020K, and the amount of change (F2,F3).

In the information processing device 3100, when it is determined thatthe controlled apparatus 3010 is being controlled in accordance with theoutput instruction, the process of control checking is ended (Yes inF3).

On the other hand, in the information processing device 3100, when it isdetermined that the controlled apparatus 3010 is not being controlledbased on the output instruction, it is determined that there is anabnormality and abnormality processing is executed (No in F3, and F4).For example, the information processing device 3100 retransmits anoutput instruction to the infrared output device 3070 as abnormalityprocessing (E9). Thus, until the controlled apparatus 3010 is controllednormally, the output instruction is repeatedly transmitted from theinfrared output device 3070 to the controlled apparatus 3010.

(3-4-3) Characteristics

As described above, the control system 3001 according to the presentembodiment includes the input receiving device 3060, the infrared outputdevice 3070, the environmental information detecting apparatus 3020K,and the information processing device 3100. The input receiving device3060 receives a control command to a controlled apparatus (first-typeapparatus) 3010 controllable by infrared ray. The infrared output device3070 outputs infrared ray to the controlled apparatus 3010. Theenvironmental information detecting apparatus 3020K detectsenvironmental information around the controlled apparatus 3010. Theinformation processing device 3100 receives the control command from theinput receiving device 3060 and transmits an infrared output instructionto the infrared output device 3070 based on the control command. Theinformation processing device 3100 receives the environmentalinformation from the environmental information detecting apparatus 3020Kand determines that the controlled apparatus 3010 has been controlledbased on the output instruction and the environmental information.

Thus, with the control system 3001 according to the present embodiment,the information processing device 3100 receives environmentalinformation from the environmental information detecting apparatus 3020Kand determines whether a controlled apparatus 3010 has been controlledbased on an output instruction and the environmental information.Therefore, when the controlled apparatus 3010 has not been controlled, aprocess for controlling the controlled apparatus 3010 can be executed.

For example, when the information processing device 3100 determines thatthe controlled apparatus 3010 has not been controlled based on theinfrared output instruction and the environmental information, theinformation processing device 3100 retransmits an output instruction tothe infrared output device 3070. Thus, the controlled apparatus 3010 isreliably controlled, so the control system 3001 with high reliabilitycan be provided.

(3-4-4) Modifications

(3-4-4-1)

In the above description, when it is determined that the controlledapparatus 3010 has not been controlled based on the infrared outputinstruction and the environmental information, an output instruction isrepeatedly transmitted from the infrared output device 3070 to thecontrolled apparatus 3010 until the controlled apparatus 3010 iscontrolled normally.

However, the process in the control system 3001 according to the presentembodiment is not limited to such control. For example, the number oftimes of output instruction to be transmitted to a controlled apparatus3010 may be limited to a predetermined number. Thus, the load on thesystem is reduced. When the information processing device 3100determines that the controlled apparatus 3010 has not been controlledbased on the infrared output instruction and the environmentalinformation, the information processing device 3100 may transmit, to theinput receiving device 3060, a notification that the controlledapparatus 3010 has not been controlled. Thus, the user 3005 of the inputreceiving device 3060 is prompted to input a control command again, sothe controlled apparatus 3010 is reliably controlled. As a result, thecontrol system 3001 with high reliability can be provided.

Particularly, in the control system 3001 according to the presentembodiment, the infrared output device 3070 is operated via theinformation processing device 3100 on the network NW, so remote controlover a controlled apparatus 3010 is possible. On the other hand, in thecase of remote control, a user 3005 a who controls a controlledapparatus 3010 can be different from a user 3005 b who uses thecontrolled apparatus 3010 (see FIG. 51). In such a situation as well,with the control system 3001 according to the modification, whenabnormality determination is made, the notification that the controlledapparatus 3010 has not been controlled is provided to the user 3005 awho controls the controlled apparatus 3010. Therefore, the controlledapparatus 3010 can be appropriately managed by the user 3005 a whocontrols the controlled apparatus 3010.

(3-4-4-2)

The above-described functions of the information processing device 3100may be executed by multiple information processing in a distributedmanner. For example, as shown in FIG. 54 and FIG. 55, the control system3001 may include a first information processing device 3100A and asecond information processing device 3200A instead of the informationprocessing device 3100. Here, the first information processing device3100A has the function of the above-described input analyzing unit, andthe second information processing device 3200A has the other functions.Supplementarily, when a controlled apparatus is controlled by voiceinput, an enormous amount of processing can be required to analyze voiceinput. Even in such a case, with the control system 3001, voice analysiscan be highly accurately performed by using the first informationprocessing device 3100A that implements neural network, or the like, andthat is constructed on the network NW. Thus, even with voice input, acontrolled apparatus and a control command can be minutely identified.As a result, the control system 3001 that can easily control anyapparatus can be provided.

(3-4-4-3)

In the above description, the information processing device 3100includes the infrared pattern DB 3104A. Alternatively, the infraredoutput device 3070 may store this information. In this case, the storageunit of the infrared output device 3070 stores the infrared pattern DB.

(3-4-4-4)

In the above description, the information processing device 3100includes the relative position DB 3104B. Alternatively, the infraredoutput device 3070 may store this information. In this case, the storageunit of the infrared output device 3070 stores the relative position DB.Even when the information processing device 3100 or the infrared outputdevice does not include the relative position DB, control over anapparatus can be, of course, implemented by the control system 3001according to the present embodiment.

Fourth Invention

Hereinafter, an operating system 4001 according to an embodiment of theoperating system of the present invention will be described withreference to the accompanying drawings.

The following embodiment is a specific example of the present inventionand is not intended to limit the technical scope of the presentinvention. The following embodiment may be modified as needed withoutdeparting from the purport of the present invention.

(4-1) General Outline of Equipment System

FIG. 56 is a schematic configuration diagram of an equipment system 4000according to an embodiment of the fourth invention. FIG. 57 is aschematic block diagram of the equipment system 4000. In FIG. 57, apartial configuration of the equipment system 4000 is not shown.

In the present embodiment, an operating system 4001 is a system thatoperates an air conditioner 4010, apparatuses 4050 a, 4050 b, . . . ,4050 n included in a first apparatus group (also referred to asfirst-type apparatuses) 4050, and apparatuses 4060 a, 4060 b, . . . ,4060 m included in a second apparatus group (also referred to assecond-type apparatuses) 4060 at a voice command of an operator. In theoperating system 4001, the air conditioner 4010, the apparatuses of thefirst apparatus group 4050, and the apparatuses of the second apparatusgroup 4060 are operable by input of a voice command to an operating unit4200. The apparatuses 4050 a, 4050 b, . . . , 4050 n included in thefirst apparatus group 4050 each are an example of an apparatus to beoperated. In other words, the apparatuses 4050 a, 4050 b, 4050 nincluded in the first apparatus group 4050 are apparatuses operable byan infrared signal, other than the air conditioner 4010.

The equipment system 4000 mainly includes the operating unit 4200, theair conditioner 4010, the first apparatus group 4050, the secondapparatus group 4060, an infrared output device (also referred to asinfrared transmitter) 4040, an analyzing server 4020, an air conditionerserver 4030, and an equipment server 4070 (see FIG. 56 and FIG. 57). Theoperating system 4001 mainly includes the operating unit 4200, the airconditioner 4010, and the infrared output device 4040. In addition, theoperating system 4001 includes a sensor 4410 that measures a current orelectric power of the first apparatus group 4050, and an environmentsensor 4430 such as an illuminance sensor, a temperature sensor, and abarometric sensor (see FIG. 57).

The air conditioner 4010, the first apparatus group 4050, the secondapparatus group 4060, and the infrared output device 4040 areapparatuses placed in a building B (see FIG. 56). For example, thebuilding B is a stand-alone house; however, the building B is notlimited thereto. The building B may be an office building, a commercialfacility, a factory, or the like. Although not limited, the analyzingserver 4020, the air conditioner server 4030, and the equipment server4070 are ordinarily installed in a place different from the building B.

In FIG. 56, only one building B in which the air conditioner 4010, firstapparatus group 4050, and second apparatus group 4060 that arecontrolled by the operating system 4001 are placed is shown.Alternatively, there may be a plurality of the buildings B. In otherwords, the operating system 4001 may be a system that controls theoperations of the air conditioner 4010, first apparatus group 4050, andsecond apparatus group 4060 respectively placed in the plurality ofbuildings B. Here, for the sake of simple description, the number of thebuildings B is one.

The numbers of the air conditioners 4010, apparatuses of the firstapparatus group 4050, apparatuses of the second apparatus group 4060,infrared output devices 4040, and environment sensors 4430 placed in thebuilding B are not limited to those shown in FIG. 56 and may be one ormultiple. Here, the description will be made on the assumption that thenumbers of the air conditioners 4010, infrared output devices 4040, andenvironment sensors 4430 placed in the building B are one and thenumbers of the apparatuses of the first apparatus group 4050 and secondapparatus group 4060 placed in the building B are multiple.

The operating unit 4200 is installed in the building B and is used tooperate the air conditioner 4010, the apparatuses of the first apparatusgroup 4050, and the apparatuses of the second apparatus group 4060 inthe building B. In FIG. 56 and FIG. 57, only one operating unit 4200 isshown; however, the number of the operating units 4200 is not limited toone and may be multiple. For example, the operating units 4200 may beplaced at a plurality of locations in the building B.

The operating unit 4200 may be a mobile terminal that can be carried tooutside the building B. In other words, the air conditioner 4010, andthe apparatuses of the first apparatus group 4050 and second apparatusgroup 4060 may be configured to be operable from the outside of thebuilding B with the portable operating unit 4200.

(4-2) Detailed Configuration

The operating unit 4200, air conditioner 4010, first apparatus group4050, second apparatus group 4060, infrared output device 4040,analyzing server 4020, air conditioner server 4030, and equipment server4070 of the equipment system 4000 will be described below.

(4-2-1) Operating Unit

The operating unit 4200 is used to input operations to the airconditioner 4010, the apparatuses 4050 a, 4050 b, . . . , 4050 n of thefirst apparatus group 4050, and the apparatuses 4060 a, 4060 b, . . . ,4060 m of the second apparatus group 4060. The operating unit 4200 is anexample of a command receiver and receives commands to the apparatuses4050 a, 4050 b, 4050 n included in the first apparatus group 4050 asvoice commands. The operating unit 4200 receives commands to the airconditioner 4010 and the apparatuses 4060 a, 4060 b, 4060 m included inthe second apparatus group 4060 as voice commands.

The operating unit 4200 is, for example, installed in the building B.For example, the operating unit 4200 is fixed to a wall surface, or thelike, or put on a table or shelf. The operating unit 4200 may be anapparatus that is exclusively used to operate the air conditioner 4010,and the apparatuses of the first apparatus group 4050 and secondapparatus group 4060, and that has functions as will be described below.The operating unit 4200 may be an apparatus that further has anotherfunction (for example, the function of a clock or music player) inaddition to the functions as will be described below.

The operating unit 4200 may be a mobile terminal. Although a type is notlimited, the mobile terminal may be a smartphone, a mobile phone, atablet terminal, a wearable terminal, or the like, having a voicereceiving unit. For example, specifically, the operating unit 4200 is awatch-type apparatus that an operator wears to carry on the wrist.

When a plurality of the operating units 4200 is used, each of theplurality of operating units 4200 may be different in type from anotherone of the operating units 4200.

The operating unit 4200 includes a CPU (not shown) that executes variousprocesses, a storage device (not shown) that stores programs that theCPU runs and various pieces of information, and the like. The operatingunit 4200 includes microphone elements 4210 a as a voice receiving unit4210, a speaker as a notification unit 4220, a voice processing chipthat executes various processes over voice acquired by the microphoneelements 4210 a, a wireless LAN adaptor that functions as acommunication unit 4250, and the like.

The operating unit 4200 includes the voice receiving unit 4210, anotification unit 4220, a voice processing unit 4230, the communicationunit 4250, and a switch 4260 as functional units (see FIG. 57).

(4-2-1-1) Voice Receiving Unit

The voice receiving unit 4210 receives input of voice commands to theair conditioner 4010, the apparatuses of the first apparatus group 4050,and the apparatuses of the second apparatus group 4060.

The voice receiving unit 4210 includes the microphone elements 4210 athat receive a voice command. The number of the microphone elements 4210a may be one or may be multiple (in FIG. 57, the number of themicrophone elements 4210 a is two).

For example, a plurality of the microphone elements 4210 a is providedwhen the operating unit 4200 is a stationary apparatus and themicrophone elements 4210 a are arranged so as to easily acquire a voicecommand from different locations. Thus, regardless of the location of anoperator (speaker), a voice command is more reliably acquired by thevoice receiving unit 4210.

(4-2-1-2) Notification Unit

The notification unit 4220 is a speaker here.

The notification unit 4220 mainly informs that the voice receiving unit4210 has received a voice command. For example, specifically, when thevoice receiving unit 4210 has received a voice command, the notificationunit 4220 informs that the voice receiving unit 4210 has received avoice command by speaking a sentence, such as “Voice is accepted” orspeaking to read back a received voice command. The notification unit4220 may be configured to, when the air conditioner 4010 performsvarious operations, inform the contents of the operations (for example,a sentence, such as “Operation is started”). The notification unit 4220may be configured to, when the apparatuses of the second apparatus group4060 perform various operations, inform the contents of the operations.

In addition, the notification unit 4220 informs information about aresult determined by a determination unit 4318 of the apparatusmanagement device 4300, which is output (sent) from a transmission unit4170 a of the apparatus management device 4300 of the air conditioner4010 (described later) to the communication unit 4250. Here, adetermined result means a result of determination as to whether the acommand content issued to an apparatus of the first apparatus group 4050with the operating unit 4200 is inconsistent with a behavior of theapparatus.

When the communication unit 4250 has received information indicatingthat the a command content to an apparatus of the first apparatus group4050 is not inconsistent with a behavior of the apparatus (the commandcontent is consistent with the behavior), the notification unit 4220speaks, for example, a sentence, such as “The apparatus has beennormally operated”. When the communication unit 4250 has receivedinformation indicating that the a command content to an apparatus of thefirst apparatus group 4050 is inconsistent with a behavior of theapparatus, the notification unit 4220 speaks, for example, a sentence,such as “The apparatus has not been normally operated”. The word“apparatus” in the sentence may be replaced with, for example, the nameof the apparatus.

The sentence that the notification unit 4220 speaks is illustrative, anda sentence that the notification unit 4220 speaks just needs to bedetermined as needed.

The speaker that serves as the notification unit 4220 does not need toprovide a notification by speaking a sentence or a word and may providea notification by beep sound, or the like.

The notification unit 4220 need not be a speaker. For example, anothernotification-type annunciator, such as a lamp that provides anotification by light, a vibrator that provides a notification byvibrations, and a display that provides notification by display ofinformation, may be used as the notification unit 4220.

(4-2-1-3) Voice Processing Unit

The voice processing unit 4230 is an integrated circuit that converts avoice command received by the voice receiving unit 4210 to data suitablefor communication. Various processes may be implemented by hardwareprocessing or may be implemented by software processing.

For example, the voice processing unit 4230 performs analog-to-digitalconversion over a voice command received by the microphone elements 4210a into a digital voice signal and further executes speech compressionprocess in various voice data compression technologies (for example,MP3, or the like). Thus, the voice processing unit 4230 generates asignal S to be transmitted from the communication unit 4250.

The processing contents of the voice processing unit 4230 areillustrative. The voice processing unit 4230 may, for example, performanalog-to-digital conversion over a voice command received by themicrophone elements 4210 a and generate a digital voice signal as thesignal S. The voice processing unit 4230 may convert a voice commandreceived by the microphone elements 4210 a into text and generate textdata as the signal S.

(4-2-1-4) Communication Unit

The communication unit 4250 is a functional unit for the operating unit4200 to communicate with the air conditioner 4010, the analyzing server4020, or the like (see FIG. 57).

The operating unit 4200 is connected to the analyzing server 4020 via anetwork 4080 (see FIG. 56). Here, the network 4080 is the Internet;however, the network 4080 may be another WAN. The operating unit 4200 isconnected to a router 4082 by a wireless LAN, and is connected to thenetwork 4080 via the router 4082 (see FIG. 56). The router 4082 includesa WAN-side interface and a LAN-side interface and establishes connectionbetween a WAN and a LAN. The operating unit 4200 and the router 4082 maybe connected not by a wireless LAN but by a wired LAN. The network 4080may be a LAN.

The communication unit 4250 is, for example, a wireless LAN adaptor thatcarries out wireless communication with the router 82.

The communication unit 4250 transmits a signal S associated with a voicecommand received by the voice receiving unit 4210 (signal S generatedfrom a voice command by the voice processing unit 4230) (see FIG. 57).Specifically, the communication unit 4250 transmits a signal Sassociated with a voice command received by the voice receiving unit4210 to the analyzing server 4020 via the network 4080 (see FIG. 57).

The communication unit 4250 may transmit a signal S further to the airconditioner server 4030 or the equipment server 4070. In other words,the communication unit 4250 may transmit a signal S to a plurality ofaddresses (for example, the analyzing server 4020 and the airconditioner server 4030) (see FIG. 57).

The communication unit 4250 also receives information about a resultdetermined by the determination unit 4318 of the apparatus managementdevice 4300, which is output (sent) from the transmission unit 4170 a ofthe apparatus management device 4300 of the air conditioner 4010(described later) to the communication unit 4250.

The communication unit 4250 may be configured to receive informationabout the contents of operations of the air conditioner 4010 andapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060, which are respectively transmitted from the transmission unit 4170a of the air conditioner 4010 and transmission units (not shown) of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060.

(4-2-1-5) Switch

The switch 4260 is a switch for changing the operational status of thevoice receiving unit 4210.

Although not limited, the switch 4260 is a push button switch. When theswitch 4260 is pushed down, the operational status of the voicereceiving unit 4210 is switched between a sleep state of not receiving avoice command and an active state of being able to receive a voicecommand.

The operational status of the voice receiving unit 4210 may be changedbetween the sleep state and the active state each time the switch 4260is pushed down. Alternatively, the operational status of the voicereceiving unit 4210 may be changed from the sleep state to the activestate only for a predetermined time as the switch 4260 is pushed down.

The operating unit 4200 does not need to include the switch 4260, andthe operational status of the voice receiving unit 4210 may be alwaysset to the active state. However, to avoid a situation that the voicereceiving unit 4210 receives voice at unintended timing (to avoid asituation that the air conditioner 4010 or any one of the apparatuses ofthe first apparatus group 4050 and the second apparatus group 4060erroneously operates without an intention), the switch 4260 is desirablyprovided in the operating unit 4200.

(4-2-2) Air Conditioner

The air conditioner 4010 is an air conditioner operable by inputting avoice command to the voice receiving unit 4210 of the operating unit4200. Although a voice command is not limited, a voice command is, forexample, voice, such as “Turn on air conditioning” and “Set the settemperature to 25 degrees C.”. The air conditioner 4010 may beconfigured to be operable with a general remote controller in additionto a voice operation.

The air conditioner 4010 also has a management function of managing theapparatuses 4050 a, 4050 b, . . . 4050 n of the first apparatus group4050. Specifically, the air conditioner 4010 includes the apparatusmanagement device 4300 that manages the apparatuses 4050 a, 4050 b, . .. , 4050 n of the first apparatus group 4050.

The air conditioner 4010 mainly includes an indoor unit 4012, an outdoorunit 4014, a connection pipe (not shown) connecting these units, acontroller 4150, an apparatus management unit 4310, and a camera 4420(see FIG. 56 and FIG. 57). The apparatus management unit 4310 and partof the controller 4150 (specifically, the communication unit 4170)function as the apparatus management device 4300.

The air conditioner 4010 is a device that air-conditions anair-conditioned space. The air-conditioned space is, for example, a roomin which the indoor unit 4012 is installed in the building B.

In the present embodiment, the indoor unit 4012 is of a wall-hangingtype. FIG. 58A is a schematic front view of the indoor unit 4012 of theair conditioner 4010 according to the present embodiment. Hereinafter,expressions, such as “left”, “right”, “up”, and “down”, may be used todescribe directions or orientations, the orientations indicated by theseexpressions are in accordance with the orientations of arrows in FIG.58A unless otherwise specified.

The indoor unit 4012 includes a body 4100 whose back side is mounted ona wall (see FIG. 56 and FIG. 58A). The body 4100 is a casing thataccommodates an indoor-side heat exchanger, a fan, and a fan motor (notshown) inside. The body 4100 has an air outlet 4120 and an air inlet4130 (see FIG. 56 and FIG. 58A).

The air inlet 4130 is an opening for drawing air in the air-conditionedspace into the body 4100. The air inlet 4130 extends in a right and leftdirection in front view as a longitudinal direction (see FIG. 58A). Theair inlet 4130 is formed in the region from the front upper part of thebody 4100 to the top surface of the body 4100.

The air outlet 4120 is an opening for blowing conditioned air to theair-conditioned space. The air outlet 4120 is formed at the lower partof the body 4100. Flaps 4122 for adjusting the wind direction in an upand down direction are disposed at the air outlet 4120 (see FIG. 56).

The type of the indoor unit of the air conditioner is not limited to awall-hanging type. For example, the air conditioner may use a ceilingconcealed indoor unit 4012 shown in FIG. 58B. FIG. 58B is a schematicbottom view of the indoor unit 4012 of the air conditioner 4010according to the present embodiment. Hereinafter, expressions, such as“front”, “rear”, “left”, and “right”, may be used to describe directionsor orientations, the orientations indicated by these expressions are inaccordance with the orientations of arrows in FIG. 58B unless otherwisespecified. An indoor unit 4012′ according to another example is, forexample, a unit that blows air in four directions.

The indoor unit 4012′ includes a body 4100′ (see FIG. 58B). The body4100′ is a casing that accommodates an indoor-side heat exchanger, afan, and a fan motor (not shown) inside. The body 4100′ has air outlets4120′ and an air inlet 4130′ (see FIG. 58B).

In the body 4100′, the air inlet 4130′ is formed in a square shape (seeFIG. 58B). The air inlet 4130′ is formed at the center portion of thebody 4100′ in bottom view (see FIG. 58B).

In the body 4100′, the air outlets 4120′ are formed at four portions atthe lower face of the body 4100′. The air outlets 4120′ are respectivelyformed near a front edge, near a rear edge, near a left edge, and near aright edge along the four sides of the square body 4100′ in bottom view.The air outlets 4120′ are formed to surround the air inlet 4130′disposed at the center portion of the body 4100′ in bottom view.

Although the drawing and description are omitted, an indoor unit of anair conditioner may be, for example, a ceiling-suspended indoor unit ora floor-mounted indoor unit, other than the types described here.

An indoor unit of an air conditioner may be a built-in unit in which thebody is not exposed to an air-conditioned space or almost not exposed toan air-conditioned space. The body of a built-in unit is disposed in awall or above a ceiling. For example, in a built-in unit, air blown froman air outlet of the body is transmitted to an opening provided at awall surface or a ceiling surface via a duct and is blown to anair-conditioned space.

In the air conditioner 4010, the indoor unit 4012 and the outdoor unit4014 are connected via the connection pipe, so an indoor heat exchanger(not shown) of the indoor unit 4012 and a compressor, outdoor heatexchanger, expansion valve, and the like (not shown), of the outdoorunit 4014 are connected by pipes, with the result that a refrigerantcircuit is formed. In the air conditioner 4010, when refrigerant iscirculated in a refrigerant circuit, a space where the indoor unit 4012is installed is cooled or heated.

The operation principle and behaviors of the air conditioner 4010 thatuses a vapor compression refrigeration cycle are generally widely known,so the description thereof is omitted. The air conditioner 4010 need notbe an air conditioner that is able to perform both cooling and heatingof an air-conditioned space and may be an air conditioner exclusive forcooling or an air conditioner exclusive for heating.

In the present embodiment, in the air conditioner 4010, heat exchange isperformed in an indoor heat exchanger of the indoor unit 4012 betweenrefrigerant flowing through the inside of the indoor heat exchanger andair in the air-conditioned space; however, the air conditioner accordingto the present invention is not limited to such an apparatus. Forexample, the air conditioner 4010 may be a device in which heat exchangeis performed in an indoor heat exchanger of the indoor unit 4012 (fancoil unit) between cool water or heat water flowing through the insideof the indoor heat exchanger and air in the air-conditioned space.

(4-2-2-1) Controller

The controller 4150 is a control device that controls the operation ofthe air conditioner 4010.

The controller 4150 includes a control board (not shown) of the indoorunit 4012 and a control board (not shown) of the outdoor unit 4014. CPUsof the control boards or other components of the indoor unit 4012 andoutdoor unit 4014, which are components of the controller 4150, executevarious processes by running various programs stored in storage devicesof the control boards and other components. The controller 4150 includesa device, or the like, such as a wireless LAN adaptor that functions asthe communication unit 4170 (described later).

The controller 4150 mainly includes the communication unit 4170 and anair conditioner control unit 4190 as functional units.

(4-2-2-1-1) Communication Unit

The communication unit 4170 is used for the air conditioner 4010 tocommunicate with the operating unit 4200, the analyzing server 4020, orthe air conditioner server 4030 (see FIG. 57). The communication unit4170 is not only used to control the air conditioner 4010 but alsofunctions as part of the apparatus management device 4300.

The air conditioner 4010 (communication unit 4170) is connected to theoperating unit 4200, the analyzing server 4020, and the air conditionerserver 4030 via the network 4080 (see FIG. 56). The air conditioner 4010is connected to the router 4082 by a wireless LAN and is connected tothe network 4080 via the router 4082 (see FIG. 56). Alternatively, theair conditioner 4010 and the router 4082 may be connected not by awireless LAN but by a wired LAN.

The communication unit 4170 is, for example, a wireless LAN adaptor thatcarries out wireless communication with the router 4082. Thecommunication unit 4170 includes a transmission unit 4170 a thattransmits information and a receiving unit 4170 b that receivesinformation as functional units (see FIG. 57).

The transmission unit 4170 a, for example, outputs (transmits)information about a result determined by the determination unit 4318 ofthe apparatus management device 4300 (described later) to thecommunication unit 4250 of the operating unit 4200 (see FIG. 57). Inother words, the transmission unit 4170 a is an example of an outputunit of an apparatus management device. Information about a resultdetermined by the determination unit 4318 is information about a resultdetermined by the determination unit 4318 as to whether a commandcontent given to an apparatus of the first apparatus group 4050 with theoperating unit 4200 is inconsistent with a behavior of the apparatus.For example, information about a determined result contains an apparatusidentification code that indicates information on which apparatus amongthe plurality of apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 and information that indicates whether the acommand content given to the apparatus is inconsistent with an actualbehavior.

The transmission unit 4170 a desirably transmits information J on astate quantity regarding at least one of the air conditioner 4010 andthe air-conditioned space to the air conditioner server 4030 (see FIG.57). Although not limited, examples of the state quantity regarding theair conditioner 4010 include a temperature or pressure of refrigerant,which is measured by a sensor (not shown) at various locations in arefrigerant circuit, the number of rotations of an inverter controlmotor (not shown) of a compressor of the outdoor unit 4014, and anopening degree of an expansion valve of the outdoor unit 4014. Althougha state quantity regarding an air-conditioned space is not limited, thestate quantity includes a measured temperature, or the like, in anair-conditioned space.

The receiving unit 4170 b, for example, receives from the outside acommand C corresponding to a signal S transmitted by the communicationunit 4250 of the operating unit 4200 (particularly, a signal S based ona voice command related to control over the air conditioner 4010). Morespecifically, the receiving unit 4170 b receives a command C generatedbased on a result of analysis of the signal S (particularly, a signal Sbased on a voice command related to control over the air conditioner4010) by the analyzing server 4020. Preferably, the receiving unit 4170b receives a command C generated by the air conditioner server 4030based on a result of analysis of a signal S (particularly, a signal Sbased on a voice command related to control over the air conditioner4010) by the analyzing server 4020 and information J on a state quantitytransmitted from the transmission unit 4170 a to the air conditionerserver 4030.

Although not limited, the command C is related to, for example, at leastone of the on/off state of the air conditioner 4010, switching of anoperating mode (such as cooling, heating, dehumidifying, or air sending)of the air conditioner 4010, change of a set temperature (targettemperature of an air-conditioned space), a target value of the numberof rotations of an inverter control motor (not shown) of a compressor ofthe outdoor unit 4014, a target value of the opening degree of anexpansion valve of the outdoor unit 4014, and a target value of therotation speed of a fan motor under inverter control of the indoor unit4012.

The receiving unit 4170 b, for example, receives from the outside secondinformation A402 on a command content to an apparatus of the firstapparatus group 4050, corresponding to a signal S transmitted by thecommunication unit 4250 of the operating unit 4200 (particularly, asignal S based on a voice command related to control over an apparatusof the first apparatus group 4050). The receiving unit 4170 b is anexample of a command information receiving unit of the apparatusmanagement device. The receiving unit 4170 b specifically receivessecond information A402 on a command content to an apparatus of thefirst apparatus group 4050, corresponding to a signal S transmitted bythe communication unit 4250 of the operating unit 4200 (particularly, asignal S based on a voice command related to control over an apparatusof the first apparatus group 4050) transmitted by the analyzing server4020. The second information A402 contains an apparatus identificationcode that indicates a command to which apparatus among the apparatuses4050 a, 4050 b, . . . , 4050 n of the first apparatus group 4050 andinformation that indicates a the command content to the apparatus. Forexample, specifically, the second information A402 contains an apparatusidentification code that indicates the apparatus 4050 a and informationthat indicates the command content “Start”.

As the receiving unit 4170 b receives second information A402, thesecond information A402 is stored in the storage unit 4314 of theapparatus management unit 4310 (described later). In addition, as thereceiving unit 4170 b receives second information A402, the firstinformation transmission unit 4312 of the apparatus management unit 4310(described later) generates first information A401 based on the secondinformation A402 received by the receiving unit 4170 b and transmits thegenerated first information A401 to the infrared output device 4040.

The second information A402 need not contain an apparatus identificationcode and information that indicates a command content to the apparatus,as described above. For example, the second information A402 may be textinformation that is an analyzed result of a signal S that is a voicesignal. Interpretation of text information (such as interpretation ofthe a command content) may be performed at the apparatus managementdevice 4300 side.

(4-2-2-1-2) Air Conditioner Control Unit

The air conditioner control unit 4190 controls the operation of the airconditioner 4010 in response to a command C that is received by thereceiving unit 4170 b, an ordinary command from a remote controller (notshown), or the like. For example, the air conditioner control unit 4190controls the operation of the compressor and expansion valve of theoutdoor unit 4014, the fan of the indoor unit 4012, and othercomponents, based on settings (such as a set temperature) of the airconditioner 4010, measured values of various sensors (not shown), andthe like, in response to a command C that is received by the receivingunit 4170 b. The air conditioner control unit 4190 may control theoperations of the various units of the air conditioner 4010 by furtherusing information (for example, information, such as where a person ispresent in an air-conditioned space) acquired by the camera 4420 (seeFIG. 58A and FIG. 58B) of the air conditioner 4010.

(4-2-2-2) Apparatus Management Device

The apparatus management device 4300 manages the apparatuses 4050 a,4050 b, 4050 n of the first apparatus group 4050 to be managed (that areapparatuses to be operated by the operating system 4001).

The apparatus management device 4300 includes the apparatus managementunit 4310 and the communication unit 4170. The apparatus management unit4310 of the apparatus management device 4300 includes a control board(not shown) provided in the indoor unit 4012 and/or the outdoor unit4014. Various programs and various data are stored in the storage deviceof the control board. The CPU of the control board executes variousprocesses by running various programs.

The apparatus management unit 4310 includes the first informationtransmission unit 4312, the storage unit 4314, a judging unit 4316, andthe 4 determination unit 318 as functional units (see FIG. 57).

Hereinafter, the apparatus management unit 4310 will be described. Thecommunication unit 4170 that is a component of the apparatus managementdevice 4300 has been already described as part of the controller 4150,so the description is omitted here.

(4-2-2-2-1) First Information Transmission Unit

The first information transmission unit 4312 transmits first informationA401 to the infrared output device 4040. First information A401 isinformation about a command to any one of the apparatuses 4050 a, 4050b, . . . , 4050 n of the first apparatus group 4050. As the receivingunit 4170 b of the communication unit 4170 receives second informationA402, the first information transmission unit 4312 generates firstinformation A401 based on the second information A402 and transmits thegenerated first information A401 to the infrared output device 4040.Second information A402 is information based on an analyzed result of asignal S by the analyzing server 4020. In other words, first informationA401 that is generated based on second information A402 is informationbased on an analyzed result of a signal S by the analyzing server 4020.

For example, it is assumed that the receiving unit 4170 b of thecommunication unit 4170 has received second information A402 thatcontains an apparatus identification code indicating the apparatus 4050a that is an apparatus to be operated and information that indicates thecommand content “Start”. At this time, the first informationtransmission unit 4312 transmits a signal instructing the infraredoutput device 4040 to transmit a command to start operation to theapparatus 4050 a by an infrared signal as first information A401.

The first information transmission unit 4312 may transmit firstinformation A401 at timing other than when the receiving unit 4170 b hasreceived second information A402. For example, when the determinationunit 4318 determines that the a command content given to an apparatus ofthe first apparatus group 4050 is inconsistent with the behavior of theapparatus, the first information transmission unit 4312 may transmit(retransmit) first information A401 to the infrared output device 4040.Retransmission of first information A401 by the first informationtransmission unit 4312 will be described later.

The apparatus management device 4300 is connected to the infrared outputdevice 4040 via a communication line. The first information transmissionunit 4312 transmits first information A401 to the infrared output device4040 via the communication line. However, the apparatus managementdevice 4300 may be wirelessly connected to the infrared output device4040, and the first information transmission unit 4312 may wirelesslytransmit first information A401 to the infrared output device 4040.

(4-2-2-2-2) Storage Unit

Various programs and various data are stored in the storage unit 4314.

Data that is stored in the storage unit 4314 includes various pieces ofinformation regarding the apparatuses 4050 a, 4050 b, . . . , 4050 n ofthe first apparatus group 4050 to be managed by the apparatus managementdevice 4300.

For example, a list of the apparatuses of the first apparatus group 4050to be managed by the apparatus management device 4300 is stored in thestorage unit 4314. The apparatuses to be managed by the apparatusmanagement device 4300 are, for example, apparatuses to which theinfrared output device 4040 disposed in the indoor unit 4012 or near theindoor unit 4012 is able to transmit an infrared signal (placed atlocations where the apparatuses are able to receive an infrared signalthat is transmitted from the infrared output device 4040).

For example, as the receiving unit 4170 b receives second informationA402, the second information A402 received by the receiving unit 4170 bis stored in the storage unit 4314. For example, it is assumed that thereceiving unit 4170 b of the communication unit 4170 has received secondinformation A402 that contains an apparatus identification codeindicating the apparatus 4050 a that is an apparatus to be operated andinformation that indicates the command content “start”. In this case,information (“Start”) that indicates the command content is stored inthe storage unit 4314 as information regarding the apparatus 4050 a. Abehavior judged by the judging unit 4316 (described later) is desirablystored in the storage unit 4314 one by one for the apparatuses 4050 a,4050 b, . . . , 4050 n of the first apparatus group 4050.

In other words, as shown in FIG. 60, for all the apparatuses 4050 a,4050 b, . . . , 4050 n of the first apparatus group 4050 to be managedby the apparatus management device 4300, the apparatus identificationcode that identifies an apparatus, the a command content to theapparatus, and the behavior of the apparatus are desirably stored in thestorage unit 4314 in association with one another. When such informationis held, the apparatus management device 4300 can hold whether thebehavior of each of the apparatuses 4050 a, 4050 b, . . . , 4050 n ofthe first apparatus group 4050 is inconsistent with the command content.

(4-2-2-2-3) Judging Unit

The judging unit 4316 judges the behavior of each of apparatuses of thefirst apparatus group 4050 based on an operational status that isdetected by an operational status detecting unit that detects theoperational statuses of the apparatuses of the first apparatus group4050.

The operational status detecting unit, for example, includes at leastone of the microphone elements 4210 a of the voice receiving unit 4210of the operating unit 4200, the camera 4420 of the air conditioner 4010,the sensor 4410 that measures a current or current of each of theapparatuses of the first apparatus group 4050, and an environment sensor4430 (see FIG. 57). In FIG. 57, only the sensor 4410 that measures acurrent or electric power of the apparatus 4050 a of the first apparatusgroup 4050 is shown; however, the sensor 4410 may be provided for eachof the apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050. The environment sensor 4430 is, for example, an illuminancesensor, a temperature sensor, a barometric sensor, or the like. Theenvironment sensor 4430 disposed in the building B is not limited to onetype, and multiple types of environment sensors may be disposed in thebuilding B. Although a communication line, and other components, areshown in FIG. 57, the apparatus management device 4300 is connected tothe microphone elements 4210 a, the sensor 4410, the camera 4420, andthe environment sensor 4430 as the operational status detecting unit soas to be communicable in a wireless or wired manner, and is configuredto be able to acquire information from the devices 4210 a, 4410, 4420,4430.

Among the illustrated microphone elements 4210 a, the camera 4420, thesensor 4410, and the environment sensor 4430, which one of the devicesis used as the operational status detecting unit in the operating system4001 may be selected as needed according to the types of the apparatuses4050 a, 4050 b, . . . , 4050 n of the first apparatus group 4050, ofwhich the operational status is detected, and the characteristics of theapparatuses. The operating system 4001 may include all the illustratedapparatuses 4210 a, 4410, 4420, 4430 as the operational status detectingunits or may include only part of the apparatuses 4210 a, 4410, 4420,4430 as the operational status detecting unit(s). The operating system4001 may use a different one of the apparatuses 4210 a, 4410, 4420, 4430as the operational status detecting unit according to the apparatus ofthe first apparatus group 4050. For example, the sensor 4410 may be usedas the operational status detecting unit for the apparatus 4050 a, andthe microphone elements 4210 a may be used as the operational statusdetecting unit for the apparatus 4050 b.

When the microphone elements 4210 a are used as the operational statusdetecting unit, the operational status detecting unit detects, forexample, an operation sound of an apparatus of the first apparatus group4050 or a notification sound at the time when an apparatus of the firstapparatus group 4050 performs a certain operation (voice, such as beepsound, that an apparatus of the first apparatus group 4050 emits fromthe speaker at the time of various operations) as the operational statusof the apparatus of the first apparatus group 4050.

When the camera 4420 is used as the operational status detecting unit,the operational status detecting unit, for example, detects the motionof an apparatus of the first apparatus group 4050 or turning on or off alamp, which indicates a behavior and is provided in an apparatus of thefirst apparatus group 4050, as the operational status of the apparatusof the first apparatus group 4050.

When the sensor 4410 is used as the operational status detecting unit,the operational status detecting unit detects the magnitude ofcurrent/electric power that is supplied to an apparatus of the firstapparatus group 4050 as the operational status of the apparatus of thefirst apparatus group 4050.

When the environment sensor 4430 is used as the operational statusdetecting unit, the operational status detecting unit detects anenvironmental value (for example, illuminance, temperature, atmosphericpressure, or the like) that changes according to a behavior of anapparatus of the first apparatus group 4050 as the operational status ofthe apparatus of the first apparatus group 4050. The type of theenvironment sensor 4430 that is used as the operational status detectingunit in the operating system 4001 may be determined as needed accordingto the type, or the like, of an apparatus whose operational status isintended to be detected. The behavior of an apparatus of the firstapparatus group 4050, which is judged by the judging unit 4316,desirably contains, for example, a start or stop of the apparatus of thefirst apparatus group 4050.

The behavior of an apparatus of the first apparatus group 4050, which isjudged by the judging unit 4316, desirably contains, for example,setting of the level of the operation of the apparatus of the firstapparatus group 4050.

Setting of the level of the operation is, for example, setting of theair volume of an electric fan when the apparatus of the first apparatusgroup 4050 is the electric fan. Although not limited, for example, thejudging unit 4316 is able to judge a set air volume of an electric fanby detecting a wind noise with the microphone elements 4210 a ordetecting a current/electric power value with the sensor 4410 andcomparing the detected result with the prestored magnitude of sound orcurrent/electric power value at the time of setting of the level.

The level of the operation is, for example, setting of brightness whenthe apparatus of the first apparatus group 4050 is a lighting devicethat is able to change the level of brightness. Although not limited,for example, the judging unit 4316 is able to judge a set brightness ofthe lighting device by detecting an illuminance with an illuminancesensor that is an example of the environment sensor 4430 and comparingthe detected result with a prestored illuminance at the time of settingof each brightness.

The level of the operation is, for example, volume setting when theapparatus of the first apparatus group 4050 is an audio instrument.Although not limited, for example, the judging unit 4316 is able tojudge a set volume of the audio instrument by detecting a sound with themicrophone elements 4210 a and comparing the detected result with apreset magnitude of sound at the time of setting of each volume.

(4-2-2-2-4) Determination Unit

The determination unit 4318 determines whether the behavior of anapparatus of the first apparatus group 4050 is inconsistent with the acommand content to the apparatus based on the behavior of the apparatusand second information on the command content to the apparatus.

Here, the case where the determination unit 4318 carries outdetermination as to the apparatus 4050 a of the first apparatus group4050 (when the receiving unit 4170 b has received second informationA402 containing the apparatus identification code that indicates theapparatus 4050 a and information that indicates the a command content tothe apparatus 4050 a) will be described in detail as an example. Forexample, here, it is assumed that the receiving unit 4170 b has receivedsecond information A402 containing the apparatus identification code ofthe apparatus 4050 a and information that indicates the command content“Start”.

The receiving unit 4170 b receives the above-described secondinformation A402, the first information transmission unit 4312 transmitsa signal instructing the infrared output device 4040 to transmit acommand to start the apparatus 4050 a by an infrared signal as firstinformation A401, and then the determination unit 4318 acquires a resultjudged by the judging unit 4316. The determination unit 4318 determineswhether the behavior of the apparatus 4050 a (here, whether theapparatus 4050 a is operating) is inconsistent with the command contentto the apparatus 4050 a, stored in the storage unit 4314 (here, “Start”)(that is, whether the behavior is consistent with the command content).

When the determination unit 4318 determines that the behavior of theapparatus 4050 a is inconsistent with the command content to theapparatus 4050 a, the first information transmission unit 4312retransmits the first information A401 to the infrared output device4040 (see step G7 in FIG. 59) as will be described later.

A result determined by the determination unit 4318 (whether the behaviorof the apparatus 4050 a is inconsistent with the command content to theapparatus 4050 a) is output by the transmission unit 4170 a to thecommunication unit 4250 of the operating unit 4200 (see step G6 and stepG10 in FIG. 59) as will be described later. The notification unit 4220of the operating unit 4200 informs an operator, or the like, of theresult determined by the determination unit 4318 and received by thecommunication unit 4250.

(4-2-2-2-5) Operation of Apparatus Management Device when Apparatus ofFirst Apparatus Groups is Operated

The operation of the apparatus management device 4300 when any one ofthe apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050 is operated will be described below. Here, the operation ofthe apparatus management device 4300 when the apparatus 4050 a isoperated will be described as an example; however, this also applies tothe case where another one of the apparatuses 4050 b, . . . , 4050 n isoperated.

Here, the following description will be made on the assumption that thereceiving unit 4170 b has received second information A402 containing anapparatus identification code that indicates the apparatus 4050 a thatis an apparatus to be operated and information that indicates thecommand content “Start”.

First, in step G1, second information A402 received by the receivingunit 4170 b is stored in the storage unit 4314. Specifically,information that indicates the command content (here, “Start”) is storedin the storage unit 4314 as information related to the apparatus 4050 a(information associated with the apparatus identification code thatindicates the apparatus 4050 a).

After that, in step G2, the first information transmission unit 4312generates a signal instructing the infrared output device 4040 totransmit a command to operate to the apparatus 4050 a by an infraredsignal as first information A401 by consulting the second informationA402 stored in the storage unit 4314. The first information transmissionunit 4312 transmits the first information A401 to the infrared outputdevice 4040.

Subsequently, after a lapse of a predetermined time from execution ofstep G2, the judging unit 4316 judges the behavior of the apparatus 4050a based on the operational status detected by the operational statusdetecting unit that detects the operational status of the apparatus 4050a (step G3).

Then, in step G4, the determination unit 4318 determines whether thebehavior of the apparatus 4050 a, judged by the judging unit 4316 instep G3, is inconsistent with the command content on the apparatus 4050a, stored in the storage unit 4314. When it is determined in step G4that there is no inconsistency (that is, it is determined that thebehavior is consistent with the command content), the process proceedsto step G5; whereas, when it is determined that there is inconsistency,the process proceeds to step G7.

In step G5, the behavior of the apparatus 4050 a (the content judged bythe judging unit 4316 in step G3) is stored in the storage unit 4314.Specifically, as shown in FIG. 60, an apparatus identification code thatindicates an apparatus, the a command content to the apparatus, and thebehavior of the apparatus, judged by the judging unit 4316, are storedin the storage unit 4314 in association with one another.

Subsequently, in step G6, the transmission unit 4170 a outputs(transmits) a result determined by the determination unit 4318 (whetherthe behavior of the apparatus 4050 a is inconsistent with the commandcontent to the apparatus 4050 a) to the communication unit 4250 of theoperating unit 4200. Particularly, in step G6, the transmission unit4170 a transmits the fact that there is no inconsistency (the fact thatthe behavior of the apparatus 4050 a is consistent with the commandcontent to the apparatus 4050 a) to the communication unit 4250 of theoperating unit 4200.

In step G7, the first information transmission unit 4312 retransmits thefirst information A401 transmitted in step G2 to the infrared outputdevice 4040.

Subsequently, after a lapse of a predetermined time from execution ofstep G7, the judging unit 4316 judges the behavior of the apparatus 4050a based on the operational status detected by the operational statusdetecting unit that detects the operational status of the apparatus 4050a (step G8).

After that, in step G9, the determination unit 4318 determines whetherthe behavior of the apparatus 4050 a, judged by the judging unit 4316 instep G8, is inconsistent with the command content to the apparatus 4050a, stored in the storage unit 4314 (whether the behavior is consistentwith the command content). When it is reversed that there is noinconsistency (that is, when it is determined that the behavior isconsistent with the command content), the process proceeds to step G5.On the other hand, when it is determined that there is inconsistency,the process proceeds to step G10.

In step G10, the behavior of the apparatus 4050 a (the result judged bythe judging unit 4316 in step G8) is stored in the storage unit 4314.Specifically, as shown in FIG. 60, the apparatus identification codethat indicates the apparatus, the command content to the apparatus, andthe behavior of the apparatus, judged by the judging unit 4316, arestored in the storage unit 4314 in association with one another.

Subsequently, in step G11, the transmission unit 4170 a outputs(transmits) the result determined by the determination unit 4318(whether the behavior of the apparatus 4050 a is inconsistent with thecommand content to the apparatus 4050 a) to the communication unit 4250of the operating unit 4200. Particularly, in step G11, the transmissionunit 4170 a transmits the fact that there is inconsistency (the factthat the behavior of the apparatus 4050 a is inconsistent with thecommand content to the apparatus 4050 a) to the communication unit 4250of the operating unit 4200.

The flowchart of the processes described here is an example of theflowchart of the processes of the apparatus management device 4300 andmay be changed as needed.

For example, the order of steps of the processes may be changed asneeded without any contradiction.

For example, the apparatus management device 4300 does not need toretransmit first information A401. When it is determined in step G4 thatthe behavior of the apparatus 4050 a is inconsistent with the commandcontent to the apparatus 4050 a, the process may directly proceed to theprocess of step G10.

For example, here, the apparatus management device 4300 retransmitsfirst information A401 only once. However, retransmission of firstinformation A401 may be performed multiple times (for example, apredetermined number of times or until the behavior of the apparatus4050 a becomes consistent with the command content to the apparatus 4050a).

(4-2-3) First Apparatus Group

The apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050 are apparatuses operable by using an infrared signal. Theapparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatus group4050 are examples of an apparatus to be operated. Although not limited,examples of the apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 include an electric fan, a luminaire, and an audioinstrument. The apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 may include, for example, an air conditioneroperable by using an infrared signal, other than the air conditioner4010. The apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 need not be connected to the network 4080.

The apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050 are apparatuses operable by using an infrared signal that istransmitted from the infrared output device 4040 in response to input ofa voice command to the operating unit 4200. Examples of contentsoperable by using an infrared signal include turning on or off of theapparatuses 4050 a, 4050 b, . . . , 4050 n, change of a set air volumein the case of an electric fan, change a set brightness in the case of aluminaire, and change a set volume in the case of an audio instrument.

The apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050 may be configured to be operable with a general infraredremote controller, or switches provided on the bodies of the apparatuses4050 a, 4050 b, . . . , 4050 n, in addition to a voice operation (inaddition to an operation by using an infrared signal that is transmittedfrom the infrared output device 4040 in response to input of a voicecommand).

(4-2-4) Second Apparatus Group

The apparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatusgroup 4060 are apparatuses operable by using a signal that istransmitted via the network 4080. Although not limited, examples of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060 include a television and a DVD recorder. The apparatuses 4060 a,4060 b, . . . , 4060 m of the second apparatus group 4060 each have awireless LAN adaptor (not shown) and are connected to the network 4080via the router 4082 (see FIG. 56). The apparatuses 4060 a, 4060 b, . . ., 4060 m of the second apparatus group 4060 are communicably connectedto at least one of the analyzing server 4020 and the equipment server4070 via the network 4080 (see FIG. 56). The apparatuses 4060 a, 4060 b,. . . , 4060 m of the second apparatus group 4060 may be connected tothe router 4082 not by a wireless LAN but by a wired LAN.

The apparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatusgroup 4060 are operated by using a signal that is transmitted from theanalyzing server 4020 or the equipment server 4070 in response to inputof a voice command to the operating unit 4200. Examples of contentsoperable by using a signal that is transmitted from the analyzing server4020 or the equipment server 4070 include turning on or off theapparatuses 4060 a, 4060 b, . . . , 4060 m, change of a channel orvolume in the case of a television, and setting of scheduled videorecording in the case of a DVD recorder.

The apparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatusgroup 4060 may be configured to be operable with a generally used remotecontroller or switches provided on the bodies of the apparatuses 4060 a,4060 b, . . . , 4060 m in addition to a voice operation (in addition toan operation by using a signal that is transmitted via the network 4080in response to input of a voice command).

(4-2-5) Analyzing Server

The analyzing server 4020 is communicably connected to the operatingunit 4200, the air conditioner 4010, the air conditioner server 4030,and the equipment server 4070 via the network 4080.

As the operating unit 4200 receives a voice command, the communicationunit 4250 transmits a signal S corresponding to the voice command to theanalyzing server 4020 via the network 4080 (see FIG. 57). Voice commandsthat are received by the operating unit 4200 include a voice commandrelated to an operation of the air conditioner 4010, voice commandsrelated to operations of the apparatuses 4050 a, 4050 b, . . . , 4050 nof the first apparatus group 4050, and voice commands related tooperations of the apparatuses 4060 a, 4060 b, . . . , 4060 m of thesecond apparatus group 4060. In other words, the analyzing server 4020receives a signal S associated with a voice command that is a command tothe air conditioner 4010, any one of the apparatuses 4050 a, 4050 b, . .. , 4050 n, or any one of the apparatuses 4060 a, 4060 b, 4060 m via thenetwork 4080.

The analyzing server 4020 is an example of an analyzing device. Theanalyzing server 4020 is a computer that analyzes a received signal S byrunning a program stored in a storage device. For example, specifically,the analyzing server 4020 performs voice recognition of a voice signalthat is a received signal S. The analyzing server 4020 may interpret themeaning of text information that is a received signal S.

In addition to the program, for example, a list of apparatuses (the airconditioner 4010, the apparatuses 4050 a, 4050 b, . . . , 4050 n of thefirst apparatus group 4050, and the apparatuses 4060 a, 4060 b, . . . ,4060 of the second apparatus group 4060) operable by each operating unit4200 may be stored in the storage device of the analyzing server 4020.In other words, the analyzing server 4020 holds that which apparatus(es)is/are operable from each operating unit 4200. As for the apparatuses4060 a, 4060 b, . . . , 4060 m of the second apparatus group 4060,information as to whether each of the apparatuses 4060 a, 4060 b, . . ., 4060 m to be controlled is a target to be directly controlled by theanalyzing server 4020 (by which each of the apparatuses 4060 a, 4060 b,. . . , 4060 m is a target to be controlled, the analyzing server 4020or the equipment server 4070) is also desirably stored.

The analyzing server 4020, for example, analyzes voice as a signal S andobtains its feature quantity, and generates text information from thefeature quantity by using a voice recognition dictionary including anacoustic model, a language model, and a pronouncing dictionary stored inthe storage device. Although not limited, text information that isgenerated by the analyzing server 4020 is, for example, textinformation, such as “Turn on the air conditioner”, “Set the settemperature of the air conditioner to 25 degrees C.”, “Turn off thelighting device”, and “Turn on the television”.

When the generated text information is associated with control over theair conditioner 4010 (for example, when text information contains akeyword associated with an air conditioner), the analyzing server 4020transmits the analyzed result of the signal S (that is, the generatedtext information) to the air conditioner server 4030 via the network4080 (see FIG. 57).

When the text information is associated with control over any one of theapparatuses 4050 a, 4050 b, . . . . 4050 n of the first apparatus group4050 (for example, when the text information contains a keywordassociated with the first apparatus group 4050), the analyzing server4020 generates second information A402 on the a command content to theany one of the apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 and transmits the second information A402 to theapparatus management device 4300 (communication unit 4170) of the airconditioner 4010. The second information A402 is as described above.

When the text information is associated with control over any one of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060 (for example, when the text information contains a keywordassociated with the second apparatus group 4060), the analyzing server4020 transmits a command corresponding to the analyzed result of thesignal S (that is, the generated text information) to the any one of theapparatuses 4060 a, 4060 b, 4060 m of the second apparatus group 4060.For example, when the text information is information related to atelevision contained in the apparatuses 4060 a, 4060 b, . . . , 4060 mof the second apparatus group 4060 (for example, “Turn on thetelevision”), the analyzing server 4020 transmits, to the television, acommand to turn on the switch. A command to any one of the apparatuses4060 a, 4060 b, . . . , 4060 m of the second apparatus group 4060 istransmitted from the analyzing server 4020 to the any one of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060 via the network 4080.

When the text information is associated with control over any one of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060 and the any one of the apparatuses 4060 a, 4060 b, . . . , 4060 mto be controlled is not a target to be directly controlled by theanalyzing server 4020, the text information is transmitted to theequipment server 4070 that controls the any one of the apparatuses 4060a, 4060 b, . . . , 4060 m. A command is transmitted from the equipmentserver 4070 to the any one of the apparatuses 4060 a, 4060 b, . . . ,4060 m via the network 4080.

(4-2-6) Air Conditioner Server

The air conditioner server 4030 is an example of a command generatingdevice.

The air conditioner server 4030 generates a command C based on ananalyzed result of a signal S by the analyzing server 4020, transmittedfrom the analyzing server 4020 (that is, text information generated bythe analyzing server 4020), and information J about a state quantityassociated with at least one of the air conditioner 4010 and theair-conditioned space, which is transmitted as needed from thetransmission unit 4170 a of the air conditioner 4010. The airconditioner server 4030 transmits a command C to the receiving unit 4170b of the air conditioner 4010 via the network 4080. Although notlimited, as the air conditioner server 4030 receives, for example, thecommand “Turn on the air conditioner” as text information, the airconditioner server 4030 determines the operations of the various unitsof the air conditioner 4010 based on the current temperature and otherinformation of the air-conditioned space and transmits the determinedoperations as a command C.

Here, the air conditioner server 4030 generates a command C based oninformation J in addition to an analyzed result of a signal S by theanalyzing server 4020; however, the configuration is not limitedthereto. The air conditioner server 4030 may generate a command C basedon only an analyzed result of a signal S by the analyzing server 4020.

The air conditioner server 4030 accumulates a signal S that istransmitted from the operating unit 4200 and performs various analysesby using the signals S.

In the present embodiment, the equipment system 4000 includes the airconditioner server 4030; however, the configuration is not limitedthereto. For example, when the air conditioner 4010 is able to directlydetermine the behavior based on an analyzed result of a signal S by theanalyzing server 4020 (that is, text information generated by theanalyzing server 4020), the air conditioner server 4030 need not beprovided. The analyzed result of the signal S by the analyzing server4020 may be directly transmitted to the receiving unit 4170 b of the airconditioner 4010 as a command C.

(4-2-7) Equipment Server

The equipment server 4070 generates a command for any one of theapparatuses 4060 a, 4060 b, . . . , 4060 m of the second apparatus group4060 based on an analyzed result of a signal S by the analyzing server4020 (that is, text information generated by the analyzing server 4020),transmitted from the analyzing server 4020. The equipment server 4070transmits a command to the any one of the apparatuses 4060 a, 4060 b, .. . , 4060 m of the second apparatus group 4060 to be operated via thenetwork 4080.

FIG. 56 shows the one equipment server 4070; however, there are multipletypes of the apparatuses 4060 a, 4060 b, . . . , 4060 m that areoperated (not by a command from the analyzing server 4020 but) by theequipment server 4070, there are desirably the equipment servers 4070 innumber corresponding to the number of the types.

When the apparatuses 4060 a, 4060 b, . . . , 4060 m each are operated bya command from the analyzing server 4020, the equipment server 4070 neednot be provided.

(4-2-8) Infrared Output Device

The infrared output device 4040 is a device that transmits a command tothe apparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatusgroup 4050 by using an infrared signal.

In one embodiment, the infrared output device 4040 is mounted in theindoor unit 4012 of the air conditioner 4010 or in the indoor unit4012′. The infrared output device 4040 is, for example, installed in theindoor unit 4012 or the indoor unit 4012′ (see the infrared outputdevice 4040 shown by the solid lines in FIG. 58A and FIG. 58B) such thatan infrared light-emitting part (for example, an infrared LED, notshown) of an infrared signal transmission unit 4044 (described later) isdisposed on the outside of the body 4100 of the indoor unit 4012 or onthe outside of the body 4100′ of the indoor unit 4012′. The infraredlight-emitting part of the infrared signal transmission unit 4044 isdesirably disposed near an infrared signal receiving unit (not shown) ofthe indoor unit 4012 or indoor unit 4012′ (a receiving unit for aninfrared signal from an ordinary remote controller to the airconditioner 4010). Part of the components of the infrared output device4040 may be disposed inside the body 4100 of the indoor unit 4012 orinside the body 4100′ of the indoor unit 4012′.

In another mode, the infrared output device 4040 need not be mounted inthe indoor unit 4012 or in the indoor unit 4012′. In other words, theinfrared output device 4040 is a device independent of the airconditioner 4010. The infrared output device 4040 is installed in thebody 4100 of the indoor unit 4012 or in the body 4100′ of the indoorunit 4012′ (see the infrared output device 4040 shown by the solid linesin FIG. 58A and FIG. 58B), or on a wall surface near the body 4100 ofthe indoor unit 4012 (see the infrared output device 4040 shown by thedashed line in FIG. 58A), or on a ceiling surface near the body 4100′ ofthe indoor unit 4012′ (see the infrared output device 4040 shown by thedashed line in FIG. 58B).

In the present embodiment, the single infrared output device 4040 isprovided for the indoor unit 4012 or the indoor unit 4012′; however, theconfiguration is not limited thereto. In another mode, a plurality ofthe infrared output devices 4040 may be provided for the indoor unit4012 or the indoor unit 4012′.

The infrared output device 4040 mainly includes a first informationreceiving unit 4042, the infrared signal transmission unit 4044, and astorage unit 4046.

The first information receiving unit 4042 receives first informationA401 transmitted from the first information transmission unit 4312 ofthe apparatus management device 4300.

An infrared signal pattern for control is stored in the storage unit4046 for each of the apparatuses 4050 a, 4050 b, . . . , 4050 n of thefirst apparatus group 4050 and each a command content.

The infrared signal transmission unit 4044 transmits an infrared signalof a pattern corresponding to the first information A401 received by thefirst information receiving unit 4042 to an apparatus to be operated(when the first information A401 is information regarding a command forthe apparatus 4050 a, the apparatus 4050 a) from the infraredlight-emitting part (not shown) by consulting the storage unit 4046.

(4-3) Characteristics

(4-3-1)

The operating system 4001 according to the present embodiment includesthe air conditioner 4010 and the infrared output device 4040. The airconditioner 4010 includes the indoor unit 4012. The infrared outputdevice 4040 is installed in the indoor unit 4012 or on a wall surface orceiling surface near the indoor unit 4012. The infrared output device4040 receives first information A401 regarding a command for anapparatus (hereinafter, which may be referred to as apparatus to beoperated) of the first apparatus group 4050 and transmits an infraredsignal corresponding to the first information A401 to the apparatus tobe operated. The apparatus to be operated is an apparatus other than theair conditioner 4010 and operable by using an infrared signal. The airconditioner 4010 includes the apparatus management device 4300 thatmanages the apparatus to be operated. The apparatus management device4300 includes the receiving unit 4170 b that serves as an example of adesignated information receiving unit, and the determination unit 4318.The receiving unit 4170 b receives second information A402 on the acommand content. The determination unit 4318 determines whether thebehavior of an apparatus to be operated is inconsistent with the acommand content to the apparatus to be operated based on the behavior ofthe apparatus to be operated and the second information A402.

Here, since the apparatus management device 4300 of the air conditioner4010 determines whether the actual behavior of an apparatus to beoperated is inconsistent with the a command content to the apparatus tobe operated (an apparatus of the first apparatus group 4050), a statewhere the behavior is inconsistent with the command content (operationfailed state) is hardly left as it is.

Since the air conditioner 4010 includes the apparatus management device4300, particularly the following advantages are obtained.

Houses, offices, and the like, are often air-conditioned by the airconditioner 4010. For this reason, when the air conditioner 4010includes the apparatus management device 4300, an apparatus to beoperated can be managed without additionally providing a deviceexclusive to management of the apparatus, so equipment cost tends to bereduced.

In addition, when the infrared output device 4040 is disposed in theindoor unit 4012 of the air conditioner 4010 or on a wall surface orceiling surface near the indoor unit 4012, the following advantages areobtained.

Furniture, and the like, are placed in a house, an office, or the like,so, depending on the installation position of the infrared output device4040, furniture, and the like, can be obstacles and, as a result, aninfrared signal may not reach an infrared photoreceiving portion of anapparatus to be operated.

The indoor unit 4012 is often provided on a ceiling or near a ceilingfrom which a space can be looked over from its original functionalviewpoint. Moreover, to achieve the purpose of air-conditioning, thereis a low possibility that furniture, such as a shelf, is disposed nearthe indoor unit 4012 so as to interfere with sending of air. In otherwords, there is a relatively low possibility that an obstacle thatinterferes with transmission of an infrared signal is installed near theindoor unit 4012.

For this reason, with the operating system in which the infrared outputdevice 4040 is installed in the indoor unit 4012 of the air conditioner4010 or on a wall surface or ceiling surface near the indoor unit 4012,the state where an operation content in a command from the infraredoutput device 4040 is inconsistent with an actual behavior of anapparatus hardly occurs in the first place.

(4-3-2)

In the operating system 4001 according to the present embodiment, theapparatus management device 4300 includes the first informationtransmission unit 4312. The first information transmission unit 4312transmits first information A401 to the infrared output device 4040.

With the operating system 4001, when the first information A401 istransmitted from the apparatus management device 4300 to the infraredoutput device 4040, an infrared signal corresponding to the firstinformation A401 is transmitted to an apparatus to be operated. In otherwords, the operation of the infrared output device 4040 to transmit asignal is controlled by the apparatus management device 4300 of the airconditioner 4010. The infrared output device 4040 is installed in theindoor unit 4012 or near the indoor unit 4012. Therefore, the operatingsystem 4001 can be implemented almost without wiring work for installingthe infrared output device 4040.

(4-3-3) In the operating system 4001 according to the presentembodiment, when the determination unit 4318 determines that there isinconsistency, the first information transmission unit 4312 retransmitsthe first information A401 to the infrared output device 4040.

With the operating system 4001, when an actual behavior of the apparatusto be operated is inconsistent with the content of an operation in thecommand, the first information A401 is resent, and, as a result, aninfrared signal corresponding to the first information A401 is resentfrom the infrared output device 4040 to the apparatus to be operated.Therefore, an operation failed state is hardly left as it is.

(4-3-4)

In the operating system 4001 according to the present embodiment, theinfrared output device 4040 is mounted in the indoor unit 4012.

The infrared output device 4040 is mounted in the indoor unit 4012.Therefore, work for connecting the infrared output device 4040 and theindoor unit 4012 on site is not required.

(4-3-5)

The operating system 4001 according to the present embodiment includesthe operational status detecting unit. The operational status detectingunit detects an operational status of the apparatus to be operated. Theapparatus management device 4300 includes the judging unit 4316. Thejudging unit 4316 judges a behavior of the apparatus to be operatedbased on the operational status that is detected by the operationalstatus detecting unit.

An apparatus to be operated with infrared ray mostly has no output unitthat outputs a behavior to the outside. However, the operating system4001 includes the operational status detecting unit that detects theoperational status of the apparatus to be operated, and the behavior ofthe apparatus to be operated is judged based on the detected operationalstatus. Therefore, even an apparatus to be operated without an outputunit, or the like, that outputs a behavior can be managed by theapparatus management device 300.

(4-3-6)

In the operating system 4001 according to the present embodiment, theoperational status detecting unit includes at least one of themicrophone elements 4210 a, the camera 4420, the sensor 4410 thatmeasures a current or electric power, and the environment sensor 4430,such as an illuminance sensor, a temperature sensor, and a barometricsensor.

The operational status detecting unit acquires an operating sound of theapparatus to be operated or a notification sound at the time ofreceiving an infrared signal with the microphone elements 4210 a,detects the behavior of the apparatus to be operated with the camera4420, or measures various state quantities with various sensors 4410,4430. Thus, the operational status of the apparatus to be operated canbe accurately acquired.

(4-3-7)

In the operating system 4001 according to the present embodiment, theapparatus management device 4300 includes the transmission unit 4170 aas an example of an output unit. The transmission unit 4170 a outputsinformation about a result determined by the determination unit 4318.

With the operating system 4001, information about a result determined bythe determination unit 4318 is output. Therefore, the state (operationfailed state) of the apparatus to be operated, where an operationcontent in a command is inconsistent with an actual behavior, is hardlyleft as it is.

(4-3-8)

The operating system 4001 according to the present embodiment includesthe operating unit 4200 as an example of a command receiver. Theoperating unit 4200 receives a command to an apparatus to be operated asa voice command and transmits a signal on the voice command to theanalyzing server 4020 via the network 4080. The analyzing server 4020 isan example of an analyzing device that analyzes a signal. Firstinformation A401 is information based on an analyzed result of a signalby the analyzing server 4020.

The apparatus to be operated can be operated by voice, so convenience ishigh.

(4-4) Modifications

Hereinafter, modifications of the above-described embodiment will bedescribed. The modifications may be combined with each other as neededwithout any contradiction.

(4-4-1) Modification 4A

In the above-described embodiment, the operating system 4001 is a systemthat is able to operate the air conditioner 4010, the apparatuses of thefirst apparatus group 4050, and the apparatuses of the second apparatusgroup 4060 by using a voice command; however, the configuration is notlimited thereto.

For example, in the operating system 4001, one of the air conditioner4010 and the apparatuses of the second apparatus group 4060 or both theair conditioner 4010 and the apparatuses of the second apparatus group4060 need not be a target to be operated. When the second apparatusgroup 4060 is not operated by using a voice command, the apparatuses ofthe second apparatus group 4060 and the equipment server 4070 need notbe included in the operating system 4001.

(4-4-2) Modification 4B In the above-described embodiment, the analyzingserver 4020, air conditioner server 4030, and equipment server 4070 ofthe equipment system 4000 are separate servers; however, theconfiguration is not limited thereto. For example, a single server mayfunction as the analyzing server 4020 and the air conditioner server4030 or functions as the analyzing server 4020, the air conditionerserver 4030, and the equipment server 4070.

Conversely, the functions of each of the analyzing server 4020, airconditioner server 4030, and equipment server 4070 described in theabove embodiment may be not implemented by a single server but by aplurality of servers.

In the above-described embodiment, the analyzing server 4020 directlyreceives a signal S that is transmitted by the communication unit 4250;however, the configuration is not limited. For example, thecommunication unit 4250 may transmit a signal S to the air conditionerserver 4030 and the signal S may be transmitted from the air conditionerserver 4030 to the analyzing server 4020.

(4-4-3) Modification 4C In the above-described embodiment, a signal S istransmitted from the operating unit 4200 to the analyzing server 4020,and second information A402 is transmitted from the analyzing server4020 to the apparatus management device 4300; however, the configurationis not limited thereto. For example, the operating unit 4200 may havefunctions described as the functions of the analyzing server 4020 in theabove-described embodiment. In this case, the operating unit 4200generates second information A402 in response to a voice command andtransmits the generated second information A402 to the apparatusmanagement device 4300.

Alternatively, the operating unit 4200 may have part or all of thefunctions of the air conditioner server 4030 and the equipment server4070 in addition to the functions of the analyzing server 4020.

(4-4-4) Modification 4D

The air conditioner 4010 of the operating system 4001 according to theabove-described embodiment is a device that adjusts the temperature orhumidity of air; however, the configuration is not limited thereto. Theair conditioner according to the present invention may be an air cleanerthat cleans air by removing dust, or the like, in air and blows thecleaned air, an air flow adjuster that adjusts the flow of air in anair-conditioned space, or other devices.

(4-4-5) Modification 4E

In the equipment system 4000 according to the above-describedembodiment, second information A402 is generated by the analyzing server4020, and first information A401 that is generated by the apparatusmanagement device 4300 that has received the second information A402 istransmitted to the infrared output device 4040; however, theconfiguration is not limited thereto.

For example, when text information that is obtained as a result ofanalysis of a signal S is associated with control over any one of theapparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatus group4050, the analyzing server 4020 may transmit the analyzed result of thesignal S (that is, the generated text information) to the airconditioner server 4030 or the equipment server 4070. In the airconditioner server 4030 or equipment server 4070 that has received theanalyzed result, second information A402 on the a command content to theany one of the apparatuses 4050 a, 4050 b, . . . , 4050 n of the firstapparatus group 4050 may be generated and transmitted to the apparatusmanagement device 4300.

For example, as shown in FIG. 61, the infrared output device of theoperating system 4001 may be an infrared output device 4040′ including acommunication unit 4042′ that is able to connect with the router 4082through a wireless LAN. The infrared output device 4040′ may receivefirst information A401, which is generated by the analyzing server 4020,via the network 4080. When configured in this way, a result determinedby the determination unit 4318 may be transmitted from the apparatusmanagement device 4300 to the analyzing server 4020, and the firstinformation A401 may be, for example, resent from the analyzing server4020 to the infrared output device 4040′ based on the determined result.

In another mode, instead of the analyzing server 4020, first informationA401 that is generated in the air conditioner server 4030 or theequipment server 4070 may be transmitted to the infrared output device4040′.

(4-4-6) Modification 4F

In the operating system 4001 according to the above-describedembodiment, the air conditioner 4010, the apparatuses of the firstapparatus group 4050, and the apparatuses of the second apparatus group4060 are operated by input of a voice command to the operating unit4200; however, the configuration is not limited thereto. For example, inthe operating system 4001, the air conditioner 4010, the apparatuses ofthe first apparatus group 4050, and the apparatuses of the secondapparatus group 4060 may be operated through text input, switchoperation, or the like, to the operating unit.

(4-4-7) Modification 4G

In the above-described embodiment, the transmission unit 4170 a that isan example of the output unit of the apparatus management device 4300outputs (transmits) a result determined by the determination unit 4318to the operating unit 4200; however, the configuration is not limitedthereto.

For example, the transmission unit 4170 a may output (transmit) a resultdetermined by the determination unit 4318 to various apparatuses otherthan the operating unit 4200 (for example, a mobile terminal of anoperator, or a notification device, such as a display and a speaker,installed separately from the operating unit 4200. The output unit ofthe apparatus management device 4300 may output a result determined bythe determination unit 4318 from a notification unit (for example, aspeaker or a display) provided in the air conditioner 4010.

(4-4-8) Modification 4H

In the above-described embodiment, the apparatuses 4050 a, 4050 b, . . ., 4050 n of the first apparatus group 4050 do not provide their ownbehaviors to the apparatus management device 4300; however, theconfiguration is not limited thereto. For example, part or all of theapparatuses 4050 a, 4050 b, . . . , 4050 n of the first apparatus group4050 may further include an infrared transmitter for providing their owncurrent behaviors or a notification on an infrared signal received fromthe infrared output device 4040, and may provide behaviors to theapparatus management device 4300 by using an infrared signal bythemselves.

The present invention is not limited to the above-described embodiments.The present invention may be implemented by modifying components withoutdeparting from the purport of the present invention in a practicalphase. The present invention may form various inventions by combining aplurality of components described in the above-described embodiments asneeded. For example, some components may be deleted from all thecomponents described in the embodiments. Furthermore, the components ofthe different embodiments may be combined as needed.

1. An operating system comprising: an input receiving device configuredto receive an input operation to operate a first-type apparatus at leastoperable by communication of an infrared pattern and a second-typeapparatus at least operable via a network; a first informationprocessing device connected to the input receiving device and includingan operation information analyzing unit configured to analyze operationinformation corresponding to the input operation; a control instructiondetermination unit configured to determine whether a result analyzed bythe operation information analyzing unit includes a control instructionto the first-type apparatus or a control instruction to the second-typeapparatus; a second information processing device connected to the firstinformation processing device and configured to, upon the controlinstruction determination unit determining that the result analyzed bythe operation information analyzing unit includes the controlinstruction to the second-type apparatus, control the second-typeapparatus via the network based on the control instruction; and aninfrared output device connected to at least one of the firstinformation processing device and the second information processingdevice and configured to, upon the control instruction determinationunit determining that the result analyzed by the operation informationanalyzing unit includes the control instruction to the first-typeapparatus, output, to the first-type apparatus, an infrared patterncorresponding to the control instruction, the first informationprocessing device or the second information processing device includingthe control instruction determination unit.
 2. The operating systemaccording to claim 1, further comprising an operating deviceaccommodating the input receiving device and the infrared output devicein the same casing.
 3. The operating system according to claim 1,wherein the input receiving device is configured to determine whetherthe second-type apparatus has been controlled by the second informationprocessing device and to transmit a determined result to the firstinformation processing device.
 4. The operating system according toclaim 1, wherein the input receiving device is configured to determinewhether the first-type apparatus has been controlled by transmission ofthe infrared pattern and to transmit a determined result to at least oneof the first information processing device and the second informationprocessing device.
 5. The operating system according to claim 1, whereinupon a result determined by the control instruction determination unitincluding the control instruction to the first-type apparatus, thesecond information processing device is configured to transmit, to theinfrared output device, an output instruction to output the infraredpattern corresponding to the control instruction to the first-typeapparatus.
 6. The operating system according to claim 1, wherein thesecond information processing device or the infrared output devicefurther includes an infrared pattern generating unit configured togenerate the infrared pattern corresponding to a control content of thefirst-type apparatus.
 7. The operating system according to claim 1,wherein the first-type apparatus includes a plurality of models, and theinfrared pattern corresponding to the control instruction varies amongthe plurality of models of the first-type apparatus.
 8. The operatingsystem according to claim 1, wherein the second-type apparatus includesat least one of the input receiving device and the infrared outputdevice.
 9. The operating system according to claim 1, wherein the inputoperation is input by voice.
 10. The operating system according to claim1, wherein the input receiving device further includes a specificoperation information identifying unit configured to identify specificoperation information to the second-type apparatus in the operationinformation corresponding to the input operation; a specific operationstorage unit configured to store the specific operation information inassociation with a specific operation; and a specific operationexecution unit configured to execute the specific operation to thesecond-type apparatus upon the specific operation information beingidentified by the specific operation information identifying unit. 11.The operating system according to claim 1, wherein the secondinformation processing device further includes an environmentalinformation acquiring unit configured to acquire environmentalinformation at predetermined timing from an environmental informationdetecting apparatus that is configured to detect the environmentalinformation that indicates a status of a surrounding environment, upon aresult determined by the control instruction determination unitincluding the control instruction to the first-type apparatus, thesecond information processing device is configured to transmit, to theinfrared output device, an output instruction to output the infraredpattern based on the control instruction and the environmentalinformation to the first-type apparatus, and upon the result determinedby the control instruction determination unit including the controlinstruction to the second-type apparatus, the second informationprocessing device is configured to control the second-type apparatus viathe network based on the control instruction and the environmentalinformation.
 12. The operating system according to claim 1, wherein thesecond information processing device further includes an environmentalinformation acquiring unit configured to acquire environmentalinformation at predetermined timing from an environmental informationdetecting apparatus that is configured to detect the environmentalinformation that indicates a status of a surrounding environment; anassociated apparatus storage unit configured to store, in associationwith any one of the first-type apparatus or the second-type apparatusand the environmental information, any one or any combination of anotherfirst-type apparatus or another second-type apparatus as at least oneassociated apparatus; an associated apparatus extracting unit configuredto extract the at least one associated apparatus from the associatedapparatus storage unit upon the control instruction determination unitdetermining that the result analyzed by the operation informationanalyzing unit includes the control instruction to the first-typeapparatus or the control instruction to the second-type apparatus; andan associated apparatus control unit, the associated apparatus controlunit being configured to perform at least one of transmitting, to theinfrared output device, the output instruction of the infrared patterncorresponding to a control content over the extracted associatedapparatus, when the other first-type apparatus is extracted as the atleast one associated apparatus by the associated apparatus extractingunit, and controlling the extracted associated apparatus via thenetwork, upon the other second-type apparatus being extracted as the atleast one associated apparatus by the associated apparatus extractingunit.
 13. The operating system according to claim 1, wherein the secondinformation processing device further includes a specific situationdetecting unit configured to detect a specific situation; a specificsituation storage unit configured to store the specific situation inassociation with a predetermined one of the first-type apparatus and thecontrol content over the first-type apparatus and to store the specificsituation in association with a predetermined one of the second-typeapparatus and the control content over the second-type apparatus; and aspecific situation control unit, upon the specific situation detectingunit detecting the specific situation, the specific situation controlunit being configured to transmit, to the infrared output device, anoutput instruction to output the infrared pattern corresponding to thecontrol content associated with the specific situation regardless of theoperation information and the specific situation control unit isconfigured to control the second-type apparatus with the control contentassociated with the specific situation regardless of the operationinformation.
 14. The operating system according to claim 1, wherein thefirst information processing device is configured to communicate with athird information processing device that is configured to operate, viathe network, a third-type apparatus different from the second-typeapparatus, the control instruction determination unit is furtherconfigured to determine whether the result analyzed by the operationinformation analyzing unit includes a control instruction to thethird-type apparatus, and upon the control instruction determinationunit determining that the result analyzed by the operation informationanalyzing unit includes the control instruction to the third-typeapparatus, the first information processing device is configured totransmit an operation command corresponding to the control instructionto the third information processing device.
 15. The operating systemaccording to claim 14, wherein the second information processing deviceand the second-type apparatus are connected via a first communicationadaptor that is configured to communicate by using a first communicationprotocol, the third information processing device and the third-typeapparatus being connected via a second communication adaptor that isconfigured to communicate by using a second communication protocoldifferent from the first communication protocol.
 16. The operatingsystem according to claim 14, wherein the input receiving device isconfigured to determine whether the third-type apparatus has beencontrolled by the third information processing device and to transmit adetermined result to at least one of the first information processingdevice and the second information processing device.
 17. The operatingsystem according to claim 14, wherein the second information processingdevice further includes an environmental information acquiring unitconfigured to acquire environmental information at predetermined timingfrom an environmental information detecting apparatus configured todetect the environmental information that indicates a status of asurrounding environment; an associated apparatus storage unit configuredto store, in association with any one of the first-type apparatus, thesecond-type apparatus, or the third-type apparatus and the environmentalinformation, any one or any combination of another first-type apparatus,another second-type apparatus, or another third-type apparatus as atleast one associated apparatus; an associated apparatus extracting unitconfigured to extract the at least one associated apparatus from theassociated apparatus storage unit upon the control instructiondetermination unit determining that the result analyzed by the operationinformation analyzing unit includes the control instruction to any oneof the first-type apparatus, the second-type apparatus, and thethird-type apparatus; and an associated apparatus control unit, theassociated apparatus control unit being configured to transmit, to theinfrared output device, an output instruction to output the infraredpattern corresponding to a control content over the extracted associatedapparatus, upon the other first-type apparatus being extracted as the atleast one associated apparatus by the associated apparatus extractingunit, the associated apparatus control unit being configured to controlthe extracted associated apparatus via the network, upon the othersecond-type apparatus being extracted as the at least one associatedapparatus by the associated apparatus extracting unit, or the associatedapparatus control unit being configured to transmit an operation commandcorresponding to the control instruction to the at least one associatedapparatus to the third information processing device, upon the otherthird-type apparatus being extracted as the at least one associatedapparatus by the associated apparatus extracting unit.
 18. A secondinformation processing device comprising: the second informationprocessing device configured to connect via a network to a firstinformation processing device including an operation informationanalyzing unit configured to analyze operation information correspondingto an input operation, and a control instruction determination unitconfigured to determine whether a result analyzed by the operationinformation analyzing unit includes a control instruction to afirst-type apparatus at least operable by communication of an infraredpattern or a control instruction to a second-type apparatus at leastoperable via at least the network, and an infrared output deviceconfigured to, upon the control instruction determination unitdetermining that the result analyzed by the operation informationanalyzing unit includes the control instruction to the first-typeapparatus, output, to the first-type apparatus, an infrared patterncorresponding to the control instruction, the second informationprocessing device being configured to, upon the control instructiondetermination unit determining that the result analyzed by the operationinformation analyzing unit includes the control instruction to thesecond-type apparatus, control the second-type apparatus via the networkbased on the control instruction.
 19. The second information processingdevice according to claim 18, wherein the second information processingdevice is configured to receive a result determined by the controlinstruction determination unit from the first information processingdevice and, upon the determined result including the control instructionto the first-type apparatus, the second information processing device isconfigured to transmit, to the infrared output device, an outputinstruction to output the infrared pattern corresponding to the controlinstruction.
 20. The second information processing device according toclaim 18, further comprising an infrared pattern generating unitconfigured to generate the infrared pattern corresponding to a controlcontent over the first-type apparatus.
 21. The second informationprocessing device according to claim 18, wherein the first-typeapparatus includes a plurality of models, and the infrared patterncorresponding to the control instruction varies among the plurality ofmodels of the first-type apparatus.
 22. The second informationprocessing device according to claim 18, wherein the input operation isinput by voice.
 23. The second information processing device accordingto claim 18, further comprising an environmental information acquiringunit configured to acquire environmental information at predeterminedtiming from an environmental information detecting apparatus to detectthe environmental information that indicates a status of a surroundingenvironment, the second information processing device being configuredto receive a result determined by the control instruction determinationunit from the first information processing device; to transmit, to theinfrared output device, the output instruction to output an infraredpattern based on the control instruction and the environmentalinformation, upon the determined result including the controlinstruction to the first-type apparatus; and to control the second-typeapparatus based on the control instruction and the environmentalinformation via the network, upon the determined result including thecontrol instruction to the second-type apparatus.
 24. The secondinformation processing device according to claim 18, further comprisingan environmental information acquiring unit configured to acquireenvironmental information at predetermined timing from an environmentalinformation detecting apparatus that is configured to detect theenvironmental information that indicates a status of a surroundingenvironment; an associated apparatus storage unit configured to store,in association with any one of the first-type apparatus or thesecond-type apparatus and the environmental information, any one or anycombination of another first-type apparatus or another second-typeapparatus as an at least one associated apparatus; an associatedapparatus extracting unit, configured to extract the at least oneassociated apparatus from the associated apparatus storage unit upon thecontrol instruction determination unit determining that the resultanalyzed by the operation information analyzing unit includes thecontrol instruction to the first-type apparatus or the controlinstruction to the second-type apparatus; and an associated apparatuscontrol unit, the associated apparatus control unit being configured toperform at least one of transmitting, to the infrared output device, theoutput instruction of the infrared pattern corresponding to a controlcontent over the extracted associated apparatus, upon the otherfirst-type apparatus being extracted as the at least one associatedapparatus by the associated apparatus extracting unit, and controllingthe extracted associated apparatus via the network, upon the othersecond-type apparatus being extracted as the at least one associatedapparatus by the associated apparatus extracting unit.
 25. The secondinformation processing device according to claim 18, further comprisinga specific situation detecting unit configured to detect a specificsituation; a specific situation storage unit configured to store thespecific situation in association with a predetermined one of thefirst-type apparatus and the control content over the first-typeapparatus and to store the specific situation in association with apredetermined one of the second-type apparatus and a control contentover the second-type apparatus; and a specific control unit, upon thespecific situation detecting unit detecting the specific situation, thespecific situation control unit being configured to transmit, to theinfrared output device, an output instruction to output the infraredpattern corresponding to the control content associated with thespecific situation regardless of the operation information and thespecific situation control unit being configured to control thesecond-type apparatus with the control content associated with thespecific situation regardless of the operation information.
 26. Thesecond information processing device according to claim 18, wherein thefirst information processing device is configured to communicate with athird information processing device that is configured to operate, viathe network, a third-type apparatus different from the second-typeapparatus, the control instruction determination unit is furtherconfigured to determine whether the result analyzed by the operationinformation analyzing unit includes a control instruction to thethird-type apparatus, and upon the control instruction determinationunit determining that the result analyzed by the operation informationanalyzing unit includes the control instruction to the third-typeapparatus, the first information processing device is configured totransmit an operation command corresponding to the control instructionto the third information processing device, the second informationprocessing device further including an environmental informationacquiring unit configured to acquire environmental information atpredetermined timing from an environmental information detectingapparatus configured to detect the environmental information thatindicates a status of a surrounding environment; an associated apparatusstorage unit configured to store, in association with any one of thefirst-type apparatus, the second-type apparatus, or the third-typeapparatus and the environmental information, any one or any combinationof another first-type apparatus, another second-type apparatus, oranother third-type apparatus as an at least one associated apparatus; anassociated apparatus extracting unit configured to extract the at leastone associated apparatus from the associated apparatus storage unit uponthe control instruction determination unit determining that the resultanalyzed by the operation information analyzing unit includes thecontrol instruction to any one of the first-type apparatus, thesecond-type apparatus, and the third-type apparatus; and an associatedapparatus control unit, the associated apparatus control unit beingconfigured to transmit, to the infrared output device, an outputinstruction to output the infrared pattern corresponding to a controlcontent over the extracted associated apparatus, upon the otherfirst-type apparatus being extracted as the at least one associatedapparatus by the associated apparatus extracting unit, the associatedapparatus control unit being configured to control the extractedassociated apparatus via the network, upon the other second-typeapparatus being extracted as the associated apparatus by the associatedapparatus extracting unit, or the associated apparatus control unitbeing configured to transmit an operation command corresponding to thecontrol instruction to the associated apparatus to the third informationprocessing device, upon the other third-type apparatus being extractedas the at least one associated apparatus by the associated apparatusextracting unit.
 27. A second information processing device configuredto connect via a network to a first information processing deviceincluding an operation information analyzing unit configured to analyzeoperation information corresponding to an input operation; and aninfrared output device configured to, upon a result analyzed by theoperation information analyzing unit including a control instruction toa first-type apparatus at least operable by communication of an infraredpattern, output, to the first-type apparatus, the infrared patterncorresponding to the control instruction, the second informationprocessing device comprising: a control instruction determination unitconfigured to determine whether the result analyzed by the operationinformation analyzing unit includes the control instruction to thefirst-type apparatus at least operable by communication of the infraredpattern or a control instruction to a second-type apparatus operable viaat least the network; and a second control unit configured to, upon thecontrol instruction determination unit determining that the controlinstruction to the second-type apparatus is included, control thesecond-type apparatus via the network based on the control instruction.